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21 Plugging the Gaps in 
SQL Server Job Tracking 


—lItzik Ben-Gan 
Learn how to handle temporal data in SQL Server 
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25 Automate SQL Server 
Error Log Checking 


—Richard Ding 
Use this custom solution to check error logs in a mixed 


SQL Server 2005 and SQL Server 2000 environment. 


31 SSIS Logging and 
Data Auditing 


—Tyler Chessman 
Use Business Intelligence Development Studio (BIDS) to 
customize package logging. 
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© Editor's Tip 
We'll be blogging from the 
Microsoft BI Conference in 
Seattle October 6-8. Check 
out our blogs at www 
sqlmag.com/blog. 
—Sheila Molnar, 
senior editor 


Generating Server-Side Traces 
—Andrew J. Kelly 

Use these T-SQL commands to capture the server-side 
trace events you're interested in and store them on a 


по locally attached disk on Ше server — —— - 


T-SQL 101: Built-In Functions 
—Bill McEvoy 

T-SQL offers three types of built-in functions, including 
scalar functions. Scalar functions let you perform a vari- 
ety of operations, such as retrieving dates and replacing 


strings, with only a few lines of code. 
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SQL Server Skills 


—Pinalkumar Dave 
Pick up seven basic query analysis rules from Dave. 
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* Connectivity to all major databases 

* Database project manager 

* Database content editor 

* SQL editor with auto-completion 

* Support for XML in databases 

* Quick connect wizard 

* Online database browser 

* Support for views and stored procedures 
* Graphical database design editor 


* Export and import functions 


Connect to any major database. Explore tables, 
views, and stored procedures. Generate, edit, 
and write your own SQL statements with 
customizable auto-completion. Edit, export, 

or import data. Modify table structures and 
relationships. Save database connections, 
SQL scripts, and graphical designs in convenient 
project files. Even take charge of XML in your 
relational database. See for yourself how 
DatabaseSpy facilitates all your database 
management tasks. 


Test drive DatabaseSpy for yourself — 
Download a free 30-day trial at www.altova.com 


SQL Server 2008: Which 
Edition Is Right for You? 


L: death and taxes, the proliferation of edi- 
tions of Microsoft products is a certainty 
we've come to expect. With eight editions, SQL 
Server 2008 has more offerings than any previ- 
ous release of SQL Server. If you're considering 
a move to SQL Server 2008, you'll need to know 
which features and functionality each edition of- 
fers so you can decide which one is right for your 
organization. 


Choosing Among 

SQL Server 2008 Editions 

Most businesses will want either SQL Server 2008 
Enterprise Edition or SQL Server 2008 Standard 
Edition. Both of these editions provide the core 
SQL Server relational database feature set as well 
as all the SOL Server business intelligence (BI) sub- 
systems. If your organization can foot the bill, SOL 
Server 2008 Enterprise Edition is definitely the way 
to go. Yes, it costs more: $24,999 per processor as 
opposed to $5,999 per processor for the Standard 
Edition. (Microsoft counts processors by mother- 
board socket rather than by CPU core.) However, 
most of the cool new SQL Server 2008 features are 
Enterprise-only, including the Resource Governor, 
Data Compression, Transparent Data Encryption, 
and Change Data Capture (CDC). Plus, if you're 
getting into virtualization for server consolidation, 
the Enterprise Edition has some important bene- 
fits—it lets you run an unlimited number of SQL 
Server 2008 Enterprise Edition instances in virtual 
machines (VMs) if all the processors in the system 
have been licensed. 

If youre economizing, the Standard Edi- 
tion still stacks up well against other enterprise- 
capable database platforms. Its inclusion of the full 
BI stack gives it more built-in features and a better 
ROI than its non-Microsoft competitors. Volume 
discount pricing and other enterprise agreements, 
such as Software Assurance (SA), lower the price 
that you actually pay for the product. 

The Developer Edition shares the same feature 
set as the Enterprise Edition, but it's licensed for 
development work only and can't be used in pro- 
duction environments. It's $49. 
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The Web, Workgroup, and Express editions have 
the core SQL Server engine code-base, but the Ex- 
press Edition doesn't include the BI subsystems. The 
Web and Workgroup editions support only SQL 
Server Reporting Services (SSRS). 

The Web Edition lets web hosting providers of- 
fer more competitively priced SQL Server-based 
database services. It's not intended for use as an 
internal line-of-business (LOB) database. Pricing 
is $15 per processor under a Services Provider Li- 
cense Agreement. 

The Workgroup Edition has limited scalability 
and is intended for departmental and branch office 
installations to support their local database appli- 
cations. It's limited by the number of processors it 
supports (two) and in the total memory it can access 
(4GB). It might be acceptable for some small busi- 
nesses, but its limited BI functionality makes it less 
useful for large organizations. The Workgroup Edi- 
tion retails at $3,899 per processor. 

The Express Edition is free. It supports a single 
processor, 1GB of RAM, and a database limit of 
4GB. Small businesses could use it as their data- 
base. Express Edition is more limited than Work- 
group Edition: Microsoft and other software 
vendors often include Express Edition with their 
applications to provide database services. Express 
Edition with Advanced Services adds SSRS to 
its core SQL Server Express relational database 
services. 

Compact Edition 3.5 is a different animal alto- 
gether. Instead of being a service-based database 
like the other editions of SQL Server, it's an in- 
process database. It's free and intended for desktop 
database services. 


Doing More Research 
For more information about licensing and pricing, 


go to www.microsoft.com/sgl/howtobuy/editions 


pricing.mspx. To learn more about which features 


are included in each SQL Server 2008 edition, 


see “Features Supported by the Editions of SQL 


Server 2008" at msdn.microsoft.com/en-us/library/ 
cc645993.aspx. 
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Michael Otey 


(mikeo@sqlmag.com) is technical director 


for Windows IT Pro and SQL Server 
Magazine and author of Microsoft SQL Server 
2008 New Features (Osborne/McGraw-Hill). 
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Shaunt 
Khaldtiance 


Q Editor's Tip 


Share your SQL Server 
code, comments, discov- 
eries, and solutions to 
problems. Email your 
contributions to r2r@ 
sqlmag.com. Please include 
your full name and phone 
number. We edit submis- 
sions for style, grammar, 
and length. If we print 
your submission, you'll 
get $100. 

—Karen Bemowski, 

senior editor 


Evaluate Index Usage in Databases 


hen you think about the job of maintaining 

indexes, what tasks come to mind? Typi- 
cally, DBAs think about tuning, defragmenting, and 
rebuilding indexes. However, you also need to identify 
whether any of your tables fall into the following cat- 
egories and, if so, take appropriate action: 

Tables without any indexes (even without clustered 
indexes). Tables without any indexes can be slow 
to query, especially if they have a lot of rows. If a 
table doesn't have any indexes, it's a good idea to 
put the necessary indexes in place to improve query 
performance. 

Tables with indexes that aren't being used. Some- 
times SQL Server doesn't use a table's index because 


it determines that 
ORE on the WEB 


using the index 
Download the code at 


isn't cost effective 
InstantDoc IDs 99980, 99985, іл terms of I/O. If 
an 


a table has a non- 
clustered index that’s not being used, you might con- 
sider dropping that index. If a table has a clustered 
index that’s not being used, you should investigate the 
reason why. 


Query 1: 


Query cost (relative to the batch): 


100% 


select * from Person.Address 


пу 


Figure 1 


Clustered Index Scan 
[Adventurelorks]. [Person]. [Address]... 
Cost: 100 $ 


Execution plan that reveals SOL Server performed an index scan 


Query 1: 


Query cost (relative to the batch): 


100% 


select * from Person.Address where AddressID=1 


Figure 2 


Execution plan that reveals SQL Server performed an index seek 


Dalabars_name 


1 | AdverhaeWodks | Employee 


2 — AdverhaeWorks Етсізуее 
3 AdverbaeWoks Employee 


Figure 3 


Табе Name кодек name 
AK Emplwee NahonsiDNumber 3 
АҚ Empkwee sgid 4 
IX Employee Managed 5 


ex хі Туре 
indexes not berg used al 0 
ікіез not being used tal 0 
indexes not being used stall 0 


Sample results that show the indexes not being used 
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Tables with indexes that aren’t being used efficiently. 
With some tables, SQL Server does more index scan- 
ning (ie, SQL Server searches the index vertically) 
than index seeking (1е., SQL Server searches the index 
horizontally). Index scanning is less efficient than index 
seeking. SQL Server determines whether to use index 
scanning or index seeking based on the index definition 
and how the query has been presented. The following 
example illustrates this. 

In the AdventureWorks database, suppose there’s 
a clustered index named PK_Address_AddressID on 
Person.Address for the AddressID column. You run 
the code 


USE adventureworks 
GO 
SELECT * FROM Person.Address 


and check the execution plan. As Figure 1 shows, the 
execution plan reveals that SQL Server performed an 
index scan for the SELECT statement. However, if you 
run this SELECT statement instead 


SELECT * FROM Person.Address 
WHERE AddressID-1 


and check the execution plan (see Figure 2), you'll dis- 
cover that SQL Server performed an index seek rather 
than an index scan. Index seeks can be quite efficient 
on large tables. 

I wrote a stored procedure, Index Evaluation ОР, 
that you can use to identify tables without indexes, indexes 
that aren't being used, and indexes that aren't being used 
efficiently You can find the code for Index Evalua- 
поп USP in the 99985.7ip Ше. (To download this Ше, go 
to www.sqimag.com, enter 99985 in the InstantDoc ID 
text box, and click the 99985 zip hotlink.) 

You can place Index. Evaluation USP іп any data- 
base, but I typically place it in msdb. Running this stored 
procedure will highlight indexless tables, unused indexes, 
and inefficient indexes for all the databases in the cur- 
rent SQL Server 2005 instance. Index Evaluation USP 
stores the results in a table called Index Evaluation Map 
within current database. Figure 3 shows sample output 
that identifies the indexes not 


totelaccerse: teeks scans lookups Вот 


0 0 0 20 being used. 

ГДЕ 10 20 —Shaunt Khaldtiance, 

Ы : 2 = senior DBA, 
CityIndex 
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As your business intelligence (ВІ) needs change, fast track 
your development efforts by adopting a single, scalable 
platform based on the trusted technology of Crystal Reports?. 
Reduce your coding requirements with a complete report 
creation, management, distribution and viewing solution 


and experience the ease and confidence that comes with 


choosing one vendor for all your BI deployment needs. 


Choose the flexible BI tools and deployment options you need to get to where you want to be. 
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Eli Leiba Find Weak Database Passwords 


he usp Check Passwords stored procedure is a 
simple T-SQL password-cracking tool that you 
can use to check the complexity of the passwords used 
for SQL Server database logins. This stored procedure 
requires access to the passwd column of the 
syslogins system table in the master database. 


system 
sys 

sa 
manager 


dba 
541 
sqldba 
дьаза 
admin 


administrators 


Figure 4 
Pswfile.txt 


Lawrence Rogers 


LISTING 1: Code to Update Rows 


DECLARE @Updates TABLE (PK Id int NOT NULL PRIMARY KEY) 


DECLARE @x int 


®-- Dummy statement to set @@ROWCOUNT = 1 


SET @x = 0 


WHILE @@ROWCOUNT > 0 


UPDATE ТОР(1000) SomeHugeTable 
SET SomeColumn = 'something' 
OUTPUT inserted.PK Id 


INTO @Updates 


FROM dbo.SomeHugeTable AS SomeHugeTable 


WHERE NOT EXISTS ( 


SELECT * 


FROM @Updates AS Updates 
WHERE Updates.PK_Id = SomeHugeTable.PK_Id 


) 
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It is unlikely that a hacker will gain access 
to the syslogins table, but nonetheless it’s a 
useful tool for finding weak passwords. 

The stored procedure takes one param- 
eter: the pathname of a text file containing 
passwords. It uses the BULK INSERT 
statement executed dynamically to load the 
password file into SQL Server. Password files 
can be obtained from a number of places on 
the web. Alternatively, you can write your 
own password file. Simply put each password 
on a separate line and save the password list 
as a text file. Figure 4 shows an example of a simple 
password file named Pswfile.txt. To use this file with 
usp Check Passwords, you'd use the code 


USE master 

GO 

EXEC usp check passwords 
"C:\temp\pswfile.txt' 


Note that you'd need to customize the password file’s 
path. 

The stored procedure uses the undocumented 
PWDCompare system function to compare each 
passed-in password against the passwd column in the 
syslogins table. The procedure will also detect blank 
passwords and trivial logins (1.е., logins that have the 
same password as their login name). 

I wrote and checked usp Check Passwords on 
SQL Server 2005 Developer Edition SP1. You can 
download the code for this stored procedure by going 
to www.sglmag.com, entering 99987 in the InstantDoc 
ID text box, and clicking the 99987.zip hotlink. 

— Hli Leiba, senior application DBA, 
Israel Electric 
InstantDoc ID 99987. 


Update Rows in Large Tables 
Without Locking Out Users 


BAs often have to update rows in tables. When 

the table is small, you might be able to update 
the entire table with a simple statement that looks 
something like 


UPDATE dbo.SomeSmallTable 
SET SomeColumn - 'something' 


For large tables, 
however, such 
a simplistic ap- 
proach is imprac- 
tical because the 
transaction size 
will lock out 
users. 

When you are 
faced with up- 
dating most or all 
rows in a large ta- 
ble and you want 
to avoid locking out users, you can use the TOP clause 
to limit the transaction size. However, there's a trick to 
using this clause: You need to keep track of which rows 
have already been updated so that you don't update 
them a second time. 

The OUTPUT clause in SQL Server 2005 and 
later provides a way to expose which rows are affected 


by a Data Manipulation Language (DML) state- 
ment. In SQL Server 2005, you can use the OUTPUT 
clause with the UPDATE, INSERT, and DELETE 
statements. In SQL Server 2008, you can also use 
the OUTPUT clause with MERGE statements. You 
declare a local table to hold the primary key values of 
the table being updated, then use the OUTPUT clause 
to capture the primary key values for the rows that are 
updated. Listing 1 shows what this code looks like. 
For the WHILE loop to start, the @@ROWCOUNT 
function must return a value greater than 0. As callout 
A in Listing | shows, you can trick the WHILE loop 
into initially executing by including a meaningless SET 
statement right before the WHILE condition. After that, 
the WHILE condition is dependent on the UPDATE 
statement’s row count. The WHERE clauses in callout 
B prevent the same row from being updated twice. 
The declared table has a clustered unique index (by 
virtue of the primary key declaration), so the UPDATE 
operation’s performance should be acceptable. You can 
tweak its performance by changing the TOP value— 
the larger the value, the quicker the update process. The 
tradeoff is that you're locking more rows for a longer 
period of time with a larger TOP value. 500] 
—Lawrence Rogers, senior consultant, 
Daugherty Business Solutions 
InstantDoc ID 99980 
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Turn Business 
Intelligence Into 
Business Advantage 


ALTERNATIVE THINKING ABOUT BUSINESS INTELLIGENCE: 


Alternative thinking isn't just about access to statistics and 
information. It's about delivering the insights you need to make 
intelligent decisions that differentiate your company from 
everyone else. 


It’s about relying on HP ProLiant and Integrity systems to run 
SQL? Server" 2008, so you can focus your efforts on business 
innovation. (And how cool is that?) 


It’s about working in close partnership with HP to instantly turn 
your most relevant information into informed business 
decisions. (And look oh-so-smart in the process.) 


It’s about experiencing a change-ready ВІ infrastructure that 
delivers actionable insight wherever it needs to be - turning 
your company into a competitive leader. (And what's not to 


love about that?) 


Technology for better business outcomes. 


HP Business Intelligence (ВІ) 

* Over 2,000 BI solutions for Fortune 500 and Global 2000 customers 

* Microsoft's SQL Accelerator for Bl was developed on HP ProLiant platforms 
* Almost 50% of SQL Server users build their Bl on HP Servers 


www.hp.com/solutions/microsoft/sqlbi 


Microsoft and SQL Server are registered trademarks of Microsoft Corporation in the United States and/or other countries. 
©2008 Hewlett-Packard Development Company, LP. 


"SQL Backup™ makes 
us Exceptional. Don't 
be the exception." 
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Cloud Computing Comes to SQL Server 


SQL Server in the Cloud 

If you've been keeping up with technology news, 
you've surely heard of cloud computing. The “cloud” 
encompasses computing services—applications, pro- 
cessing, storage, data protection, to name a few— 
hosted by offsite third-party providers. The upside 
of cloud computing: 24 x 7 access to applications 
and data without the overhead of an onsite IT team 
to maintain them. The downside: potential loss of 
control of your organization’s data. SOL Server 
Magazine contributing editor Brian Moran recently 
pondered whether we'll eventually see SQL Server 
applications and data in the cloud (see “Cloud 
Computing: How Will It Affect Corporate IT?,” 
InstantDoc ID 99835). 

With SQL Server Data Services (SSDS) now in 
beta, the question makes sense. SSDS is Microsoft’s 
first attempt to offer on-demand, online data storage 
and querying services. (For more information, see 
“SQL Server Data Services,” June 2008, InstantDoc 
ID 98881 and the Microsoft SQL Server Data 
Services web page at www.microsoft.com/sql/data 
services/default.mspx.) Although SSDS actually runs 
on Microsoft’s SQL Server systems, for end users, it 
isn't really SQL Server—rather, it’s just a means to 
store data and access it through querying. 

In a cloud-based world where the data service, 
not the database platform, is king, what becomes of 
the DBA? Brian’s answer: “It’s reasonable to assume 
that cloud-based IT services will require fewer pro- 
fessionals to keep them up and running..., [and] 
cloud-based IT services lend themselves to be 
hosted from locations in which the cost of labor is 
substantially less than ‘big city, white-collar IT sala- 
ries.” Reader comments on the article generally agree 
with Brian’s conclusion, although shawnwjohnson 
thinks that businesses will choose to keep control 
of sensitive business and personal data while ceding 
control of nonsensitive data and applications to the 
cloud. What do you think? Is it only a matter of time 
before your company moves its applications and data 
into the cloud? And if that happens, what career 
steps will you take to prepare for the shift to cloud 
computing? 
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Performance Debate 

DBAs arent the only SQL Server pros concerned 
about database performance; SQL Server developers 
also need to keep application performance in mind 
as they write database programs. Michael Campbell 
covered this angle in his article, “Performance Secrets 
for SQL Server Developers" (July 2008, InstantDoc 
ID 99148) and got thoughtful feedback from several 
readers. 

Kurt Survance liked the articles tips overall but 
disagreed with Michael's recommendations about 
configuring Address Windowing Extensions (AWE) 
memory usage. “As I understand it..., AWE is irrel- 
evant unless a machine has more [than] 4GB of RAM, 
not 2GB as implied here.... I know that there is a lot 
of disinformation, partial information, and outright 
wrong information on this topic. Most of it springs 
from a confusion between physical memory and virtual 
address space.... I have configured AWE on many sys- 
tems, and it worked fine. I... never tried enabling AWE 
on a system with less than 4GB because there seemed 
to be no point, since any 32-bit process can access 4GB 
of RAM without AWE." 

Reader Garry Mortimer disputed Michael's tip 
about improving performance by using multiple data 
files, referring to a Microsoft PSS SQL Support blog 
post stating that the more-data-files-equals-better-I/O- 
performance meme is an "urban legend" (see blogs 
-msdn.com/psssgl/archive/2007/02/2 | /sgl-server-urban- 


legends-discussed.aspx). “I’m not sure if your article 


specifically [recommends creating] 0.25 to 1 data file 
per file group per processor (point 9). If yes, I don't 
think I would agree with it as I feel this recommenda- 
tion is only contained to tempdb.... Most people have 
this misconception of a worker allocated per data file 
in SQL. Actually, this one worker per data file is... 
when you create [a] database [on a] different drive. 
Hence, workers do the creation so the database may be 
created faster due to parallel work streams." We passed 
along Garry's comment to Michael; check the article 
comments to see how Michael responded. [SQL 
InstantDoc ID 100060 

—Anne Grubb, website strategic editor, 

SQL Server Magazine 
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technology for SQL Server Solutions at Quest 
Software and a founding board member of 
the international Professional Association for 
SQL Server. He is the author of SQL in a 
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MREMOTE 


BENEFITS: mRemote lets you manage all of your 
remote server connections from one GUI and 
supports many connection protocols. 


SYSTEM REQUIREMENTS AND NOTES: Win- 
dows Vista or Windows XP; the Microsoft .NET 


Framework 2.0. 


HOW TO GET IT: You can download mRemote 
from www.mremote.org/wiki/. 
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ORE on the WEB 


See the web figure at 
InstantDoc ID 99804. 


mRemote 


Easily manage your remote server connections 


from a central GUI 


his month’s free tool isn’t necessarily a SQL 

Server tool, but it’s such a good Windows tool 
that I thought you should know about it. mRemote is a 
free, open-source remote connections management tool 
that was written using the Microsoft .NET Framework. 
Let's look at how you can use mRemote to manage all 
your remote server connections from a central GUI. 


mRemote’s Features 

This tool supports a wide range of connection proto- 
cols, including 

* Remote Desktop Protocol (RDP) 

* Virtual Network Computing (VNC) 

* Citrix XenApp 

* Secure Shell Handler (SSH) 

* TELecommunication NETwork (TELNET) 
* HTTPS 

* Rlogin 

* RAW 


You can store mRemote connection information in 
SQL Server. Storing connection details in SQL Server, 
instead of in native XML flat files, lets you see new or 
changed connections in real time in all mRemote ses- 
sions that are connected to the database. 

You can import connections directly from 
Active Directory and then use mRemote's folders 
to organize your connections into groups 
or subgroups, as shown in the Connec- 
tion pane in Web Figure 1 (www.sglmag 
.com, InstantDoc ID 99804). mRemote 
lets you use inheritance on folders to store 
properties that underlying connections can then inherit. 
You can also store “global credentials" (1е., logon 
credentials that are used 
when no other creden- 
tials are supplied) that can 
be used when no other 
credentials have been 
assigned to a connection. 
This functionality can be 
useful for implementing 
domain-wide credentials. 
For example, you might 
have three servers that you 


connect to in one domain and three servers that you 
connect to in another domain. You can simply create 
two folders, one for each domain, with global creden- 
tials that will then be applied to any servers in those 
folders that you want to connect to. 

mRemote also includes several nice usability fea- 
tures. For example, mRemote will ping your registered 
servers and show whether the server responded to 
the ping by providing a Host Up or Host Down 
status. In addition, it will automatically reconnect 
when a connection to a server is dropped and maintains 
information in logs for your RDP connections. If you 
have a lot of connections to manage, you'll like mRe- 
mote's Quick Connect and Quick Search features, which 
let you open a connection without creating an entry and 
quickly find a connection without searching through all 
of your folders, respectively. You can also assign icons to 
your connections so that you can easily identify them. 

The tool includes several features that are typically 
found only in professional software, such as tooltips, 
which appear when you hover over connections; a 
useful system tray icon and "auto update" feature, 
which automatically downloads the latest version 
of mRemote; and a screenshot manager. Note that 
mRemote was tested on 32-bit environments and is 
unsupported on 64-bit environments. 


Supporting Software 
Its important to know that you'll have to down- 
load additional software to support certain con- 
nection protocols. For example, you'll need to 
download Microsoft Terminal Services Client 6.0 
(www.microsoft.com/downloads/details.aspx? 
FamilyId-26F11F0C-0D18-4306-ABCF-D4F18C8F5 
DF9&displaylang=en) if you plan to use mRemote 
to manage RDP connections. (The Terminal Services 
ActiveX Controls mstscax.dll and msrdp.ocx must 
be registered before you can manage RDP connec- 
tions.) You'll also need to install the Citrix XenApp 
or XenDesktop client (www.citrix.com/English/SS/ 
downloads/index.asp) to manage XenApp connections 
using mRemote. (The Citrix Presentation Client, wfica 
.ocx, must be registered before you can manage Citrix 
XenApp connections.) 500 
InstantDoc 1D 99804 
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PASS Community Summit 20 


November 18 – 21 | Seattle, WA 


Action-Packed Agenda for Microsoft SQL Server Professionals 


Expecting over 3,000 attendees, the PASS Community Summit 2008 provides the perfect 
opportunity to sharpen and perfect your SQL Server technical skills. There is much to learn 
at this year's biggest and best ever PASS Community Summit. Agenda highlights include: 


* Choose from 14 pre-conference in-depth seminars 


* Listen to outstanding keynote speakers Ted Kummert, Tom Casey, and David DeWitt 
from Microsoft Corp. 


* Attend over 130 technical and skills development track sessions 

* Choose from four available session tracks: DBA, App Dev, ВІ and Professional Development 
* Meet the Microsoft SQL Server development team 

* Participate in Microsoft Certification testing 

* Develop your skills during the hands-on-labs 


* Join in the fun at the SOL Server Heroes Evening Event 


Find out more and register today at http://summit2008.sqlpass.org 


William Sheldon 


bsheldon @ interknowlogy.com) is a con- 


tributing editor for SQL Server Magazine, a 
principal engineer with InterKnowlogy, and 
a Microsoft MVP for Visual Basic .NET. He's 
coauthor of Professional Visual Basic .NET 

with .NET 3.0 (Wrox) and an instructor at 
University of California, San Diego. 
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programmers have been us- 

ing ADO.NET for a rela- 

tional view of data for some 
time. ADOMD.NET extends ADO.NET by incorpo- 
rating multidimensional data functionality. You can 
learn about ADOMD.NET by going through the 
process of building a custom application. First you'll 
want to examine how ADOMD.NET works with 
cubes and see how to use a sample cube in coding a 
custom application. The custom application requires 
the use of an MDX query on the cube. Building the 
custom application shows how the ADOMD.NET 
object model allows you to draw upon your familiari- 
ty with ADO.NET as you query data stored in a SQL 
Server Analysis Services (SSAS) database. Because 
the following example is based on the sample SQL 
Server AdventureWorksDW database, which doesn’t 
ship with any active cubes, I’m using the cube created 
in“Creating Dimensions in SSAS, Part I,” Instant- 
Doc ID 98510 and “Creating Dimensions in SSAS, 
Part II,” InstantDoc ID 98699 as a prerequisite to the 
code used in this article. You can download the script 
to produce the cube; the AdventureWorksDW.xmla 
file is in the 99908.zip file. To download this file, go to 


www.sqlmag.com, enter 99908 in the InstantDoc 


ID text box, and click the 99908.zip hotlink. For 
more information about working with ADOMD 
.NET, see the web Learning Path that goes with 
this article at InstantDoc ID 99908. 


MDX Queries Against Cubes 

You can use ADOMD.NET to create custom multi- 
dimensional queries against an SSAS data cube within 
your application. ADOMD.NET can be used as part 
of an application that you design and build from the 
ground up. This article will focus on the requirements 
of building such an application. Before working with 
ADOMD.NET, you need to have an understanding 
of the MDX query syntax. For more information, see 


the sidebar “MDX Queries,” page 18. 

In addition to understanding MDX query syntax, 
you'll also need the following MDX query created es- 
pecially for use in this custom application. 


Select [Ship Date].[Calendar Year]. 
MEMBERS on Columns, 
[Product].[Dim Product].CHILDREN 
on Rows 
From [AdventureWorksDW] 
Where [Measures].[Sales Amount] 


To learn how this query was constructed, see the side- 
bar, ^Using SQL Server Management Studio 2005 to 
Build MDX Queries," page 19. 


Coding ADOMD.NET 

Data Access 

To create your custom application, open Microsoft 
Visual Studio 2008 and create a new Windows Forms 
project. This example I created uses a Visual Basic 
project called АПОМО NET. This project, shown in 
Figure 1, will host your application code. In Figure 
1, the Toolbox is open and the DataGridView is se- 
lected. You'll be using them next. 

My example loads a grid with the query results 
when the application is started in order to minimize 
coding not related to the ADOMD МЕТ classes. To 
implement the grid, use a DataGridViewControl. To 
add the grid to the display area, in the Toolbox click 
Data, and then drag DataGridView onto the Form. 
Next, modify the properties of the grid to dock it to 
the form. Double-click the Form’s title bar to gener- 
ate an event handler for the Form’s load event. 

You've triggered the generation of a new event 
handler where you'll place your custom code. Visual 
Studio has also updated your environment so that the 
newly generated method appears in the text editor. But 
before using the ADOMD.NET classes you need to 
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Create and use multidimensional 
queries on SSAS data cubes 


reference the SSAS ADOMD.NET 


> ADCIO NET - Micreizft Virsal Stucke 


Ве EM уен Peer Bud De Dro Io Tek Ager Window Hep 


Client library. The typical project 
templates don't default with a refer- "TTE 
ence to this class library so you need 
to add it manually. To reference the 
library, right-click your project in 
the Solution Explorer window and 
select Add Reference. This opens the 
Add Reference dialog box, which is 
shown in Figure 2 with the Micro- 
soft. Analysis Services. AdomdClient 
library selected. Double-click this 
selection or select the library and 
click the OK button to add the ref- 
erence. Note that the correct version 
of the library for SQL Server 2005 is 
9.0.242. 

With the addition of the SSAS 
ADOMD.NET Client library, you're 
ready to start coding. You should 
be able to draw on your experience 
coding with ADO.NET when you 
code with ADOMD.NET. The simi- 
larities between the two outweigh the 
differences. Both ADO.NET and ADOMD.NET have 
Connection, Command, and DataAdapter objects and 
can reference DataSet, DataTable, and DataReader 
objects. 

However, the Connection, Command, Data- 
Adapter, and DataReader objects in ADOMD.NET 
are slightly different from the equivalent objects in 
ADO.NET because the ADOMD.NET objects en- 
capsulate a different connection. Instead of creating a 
SQL Connection object, as you would in ADO.NET, 
you define your connection with an AdoMdConnec- 
tion object in ADOMD.NET. But the behavior of 
these objects is similar. The behavior and the inter- 
faces for DataTable and DataReader objects are the 
same in ADO.NET and ADOMD.NET. 

One object in ADOMD.NET isn't present in 
ADO.NET—the CellSet. With CellSet you can cre- 
ate a multi-dimensional MDX query and maintain 
the relationships between the various data elements 
within the results. CellSet maintains the same hierar- 
chical relationships that exist within the cube within 
the results that you have retrieved. CellSet does this 
by containing a copy of the data, plus a copy of the 
metadata that defines the MDX relationships. 

Working with CellSet lets you create a UI that 
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exposes the metadata so that the displayed results can 
be customized by the end users, just as they would 
manipulate data in a pivot table or other business in- 
telligence (BI) application. 

Now you're ready to use ADOMD.NET to open 
a connection to SSAS, retrieve your cube's data, 
and display that data. First, you'll add the Ado Md 
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Figure | 


Creating a project in 
Visual Studio 


Symitirapper 
Microsoft SQL Mobile 
| Microsoft AnalysisServices, AdomdChant 


Component Name - Version 
EEcecRemote 2009 
IEHost 2050 
TEHost 2000 
InfoPath, DornainContro! 11000 
IrfePath.DemainControl 1000 
2000 2050727 
902420 


Runtime 
v20.50727 
2050727 
у2050727 
114322 
14.4322 


Microsoft AnalysisServices.Xmla 


Figure 2 
The Add Reference dialog box 


902420 
Microsoft Build. Conversion 2000 
Microsoft Build. Conversion.v3.5 3500 


. т 


С 42050727 
205072 
v2050727 
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MDX QUERIES 


MDX queries are to SQL Server Analysis Services (SSAS) multidimensional data 
as T-SQL queries are to relational data. Although the syntax of a dimensional 
query varies from that of a relational query, working with MDX queries can 
become as comfortable as working with T-SQL queries over time. 

To illustrate, let's look at how to code a simple MDX statement to query data 
from the SSAS cube created in the articles "Creating Dimensions in SSAS, Part 
1,” InstantDoc ID 98510 and "Creating Dimensions in SSAS, Part II,” InstantDoc 
ID 98699. 

Before creating the MDX statement, you need to know a couple of key syntax 
elements for MDX. A basic MDX structure takes the format of 


Select «row axis, mdx set,» on Columns, 
«column axis, mdx set,» on Rows 

From «from clause, тах пате, > 

Where «where clause, тах set,» 


This example starts with a Select statement that should look vaguely familiar 
to ADO.NET developers. The «row axis, mdx set,» defines the first dimension, 
for columns. A cube allows you to reference how data behaves across its dimen- 
sions; the first part of the Select statement defines a dimension that will form the 
horizontal axis of a grid. By laying out these elements horizontally, you define the 
columns of that grid, as specified by the on Columns qualifier. 

The on Columns qualifier is followed by the definition of the second dimen- 
sion, for rows. This is the vertical dimension of your grid, which defines the rows 
of that grid, as specified by the on Rows qualifier. (You can also use an MDX 
query to define other types of structures; this example introduces the MDX syntax 
for only the Select statement. For articles that give you more information on MDX, 
see the web Learning Path at InstantDoc ID 99908.) 

Next, the From clause names the location the data is retrieved from. In an 
MDX query, this location is typically the name of the cube you're using. Finally, 
the Where clause defines the data that will be applied. Most SQL developers see 
a Where clause as a way to exclude results. The MDX Where clause allows you to 
screen by identifying the data that should be included. You arrive at a similar end 
result with T-SQL. Think of screening that explicitly includes the data that meets 
a specified condition. For most MDX queries, the condition is simply that it exists 
in a given location. 

When you understand how a simple query description works, you can try your 
hand at creating a query. The most basic method is to type the complete MDX 
query with its specific dimension- and fact-related information. However, you can 
also do this using a toolset with a graphical Ul, such as the SQL Server 2005 Data 
Mining Add-ins for Microsoft Office 2007. The Data Mining Client for Excel allows 
you to graphically add data elements and generate the resulting MDX query. You 
can use this tool to build your MDX query and then copy and paste that query into 
your custom application. More information on this package and a link to the down- 
load is available at www.microsoft.com/sq|/technologies/dm/addins.mspx. 
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Connection object to your code 


Dim advwrksConn As New AdomdConnection( _ 
"Data Source- 
localhost;Catalog- 
AdventureWorksDW") 


This line of code creates a new AdoMdConnection 
object. The connection string is simple. Because it 
doesn't define a specific authentication method, in- 
tegrated authentication with your running account 
will be used. You can customize the connection 
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Type 'AdomdConnection' is not defined. 


Import 'Microsoft.AnalysisServices.AdomdClient', 


Change 'AdomdConnection' to 
'Microsoft.AnalysisServices.AdomdClient.AdomdConnection', 


Change 'AdomdConnection' to 'Odbc.OdbcConnection'. 


Change 'AdomdConnection' to 'OleDb.OleDbConnection'. 


Change 'AdomdConnection' to 'FormCollection'. 


Figure 3 


Choices in the Imports statement drop-down box 


string to use a specific account or to use other set- 
tings that are defined for any common ADO.NET 
connection. 

When you first type this line into your code, you 
should receive an error because it doesn't fully qualify 
the AdomdConnection object as coming from the 
Microsoft. AnalysisServices. AdomdClient namespace. 
You can go to the top of your file in Visual Studio 
and add an Imports statement for this library. You 
can also use a drop-down box by clicking the red 
square at the lower- right corner of your object. The 
drop-down box , shown in Figure 3, offers to auto- 
matically add the necessary imports statement for 
you. Selecting this option will update your code and 
resolve the error. 

When you have a connection, you can use an 
MDX query within the following code to create a 
data adapter that references this connection: 


Dim dataAdapter As New 

AdomdDataAdapter( _ 

"Select [Ship Date]. [Calendar 
Year].MEMBERS on Columns," & _ 

" [Product].[Dim Product]. 
CHILDREN on Rows" & _ 

" From [AdventureWorksDW]" & _ 

" Where [Measures]. [Sales 
Amount]", _ 

advwrksConn) 


This code takes the MDX query defined for use in 
this custom application and passes it as a string to a 
newly created AdomdDataAdapter. Along with the 
query, the connection information is passed to the 
data adapter. Now this data adapter can be used to 
fill a data set. So the next step is to create and fill a 
data set, using the following code: 


Dim ds As New DataSet() 
dataAdapter.Fill(ds) 


Now you're ready for the last step, which 1s displaying 


the data in the data grid. To do so, run the following 
code: 
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DataGridViewl.DataSource - 
ds.Tables(0) 

to you. 

At this point you're ready to run your new ap- 

plication code and review the results. Figure 4 shows 

the application after startup. It's certainly not in 

a production-ready state, but you'll note that the 

data is retrieved and displayed within your custom 


ADOMD.NET 


application. Any further manipulation of the data, 
such as formatting the column names, would be up 


Deployment 

When you're deploying applications that reference 
the ADOMD.NET library, keep in mind that the 
.NET Framework doesnt install the ADOM.NET 


USING SQL SERVER MANAGEMENT STUDIO 2005 


TO BUILD MDX QUERIES 


You can use the graphical environment in SQL Server Management 
Studio 2005 (SSMS) to build MDX queries against cubes. This 
example shows how to build the following query: 


Select [Ship Date].[Calendar Year].MEMBERS on 
Columns, 
[Product].[Dim Product].CHILDREN on Rows 
From [AdventureWorksDW] 
Where [Measures].[Sales Amount] 


After you've set up a cube in Microsoft Visual Studio 2005, 
deploy it to your local SQL Server database. When the cube is on 
your local database, you 
can build a query against 
it. In SSMS 2005, go 
to the upper-left side of 
the toolbar and click the v 
Analysis Services MDX 
Query button (the third 
button from the left). A 
prompt asks you to define 
your database connection. 
After you've referenced 
your local server, the query 
pane opens, as shown in 
Figure A. 

Next, look for the Tem- 
plate Explorer pane to the 
right of the query pane. 

If it isn't visible, click 
View, Template Explorer to 
display it. The default view 
in Template Explorer is a series of templates for creating T-SQL 
commands. However, by clicking the Analysis Services MDX Query 
button, you've switched this view to display Analysis Services Tem- 
plates, as Figure A shows. 

In the Template Explorer, click MDX template, Queries. As you 
can see in Figure A, the first item in the Query list is the Basic 
Query. Drag the Basic Query from the Template Explorer into the 
query pane to display the Basic MDX Query definition. Update this 
definition by using the metadata for your sample cube; this is dis- 
played in the Metadata tab to the left of the query pane. First you'll 
create columns and then you'll create rows. 

Use the metadata in the list to define the columns based on the 
years dimension. Click Ship Date, and then Ship Date. Calendar 
Year. To add this definition to the Basic MDX Query, click the loca- 
tion in the template place holder where you want it to go and then 
drag the Ship Date. Calendar Year attribute to that location in the 
query. In Figure A you can see the text [Ship Date]. [Calendar Year] 
at the top of the query. While this code would build, it probably 
wouldn't produce the specific results you want. For more precise 
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Figure A 
Creating a query in SSMS 
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results, you need to further define what you want from this attri- 
bute. 

For this example, ІЛІ introduce two keywords, the first of which is 
MEMBERS. The MEMBERS designation tells the query engine that 
you want a column for the top summation for this attribute as well as 
for each of the items that make up this attribute. In this case, you'll 
get a summation column for all of the years and a column for each 
year. After [Ship Date]. [Calendar Year], append .MEMBERS prior to 
the on Columns text in the query as shown in Figure A. 

Next, follow the same steps to create the rows. l've entered the 
Product dimension into the query and used the Dim Product attri- 
bute. I’ve also specified that | want only the children of the Rows 

attribute. The only differ- 
ence between the CHIL- 
DREN and MEMBERS 
keywords is the sum- 
mation. Because I'm 
looking only at the child 
attributes that make 
up this dimension, the 
query engine won't 
return a row represent- 
ing the top-level query. 
The remaining por- 
tions of the query are 
straightforward. The 
From clause names 
the location the data 
is retrieved from; in an 
MDX query it's usually 
the name of the cube. In 
this case, you'll populate 
the From clause by dragging AdventureWorksDW from the Cube 
Metadata pane and dropping it into the query pane next to the 
From clause. Next, you'll populate the Where clause, which defines 
the data that will be applied. The Where clause needs a data ele- 
ment that's measured by dimensions. In the Cube Metatdata pane, 
the only measure defined for this sample cube is Sales Amount, so 
you'll drag and drop Sales Amount to populate the Where clause. 
Here's the final query: 


Select [Ship Date].[Calendar Year].MEMBERS on 
Columns, 
[Product].[Dim Product].CHILDREN on Rows 
From [AdventureWorksDW] 
Where [Measures].[Sales Amount] 


Click the Execute button on the SSMS toolbar to test this query. 
The results are displayed in the bottom half of the Query pane, as 
Figure A shows. 
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Figure 4 


The custom application 


library by default. This means that if you reference 
ADOMD.NET you need to also include the redis- 
tributable package for it with your application. The 
correct version of ADOMD.NET for SSAS 2005 
is part of the SQL Server 2005 November 2005 


Feature Pack or later, with February 2007 being the 
most recent release. SQL Server 2008 has a similar fea- 
ture pack which contains the ADOMD.NET libraries. 
You can download the February 2007 Feature Pack with 
the ADOMD.NET redistributable at: www.microsoft 
.com/downloads/details.aspx? FamilyID=50b97994- 


8453-4998-8226-fa42ec403d17&displaylang=en. Add 


the associated package SQLServerADO MD.msi 
(or one of the 64-bit versions of this package) as a 
prerequisite to your installation's Setup.exe file. Note 
that MSI files don't install prerequisites—only Setup 
(ехе files that can be generated with your MSI package 
will reference prerequisite packages. 


Extending ADO.NET 
Ihope this exercise building a custom application has 
shown you how to get started using ADOMD.NET 
to handle complex queries as well as retrieve multi- 
dimensional data. The fact that ADOMD.NET 
objects and ADO.NET objects share a lot of com- 
mon syntax means you'll spend less time learning 
ADOMD.NET when you already know ADO.NET. 
This should free you up to focus on the details of the 
new MDX query syntax and quickly integrate these 
queries into your custom applications. ЕР 
InstantDoc ID 99908 
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SDB301: SQL AGENT 
ANDREW KELLY 


SQL Server Agent is used by almost every DBA but 
most do not truly understand it's potential. SQL 
Server 2005 along with 2008 has brought some 
great new additions to the SQL Server Agent, which 
makes it even more useful and secure than ever. We 
will explore each of the security roles associated 
with SQL Agent including the proper use of Proxy 
accounts and Credentials that make SQL Agent flex- 
ible yet secure. Several other aspects that you are 
probably under utilizing now including Tokens, 
Alerts, Schedules and more will be covered in detail 
along with demos that highlight each area. 


SDB302: CLUSTERING IN SQL SERVER 2008 
RONALD YENKO 


Have you always wanted to set up a high availability 
SQL Server cluster but thought it was too expensive 
or complicated? In this session, we'll take a look at 
where clustering makes sense (and maybe where 
another approach might fit better). We'll go through 
a methodology on how to design and set up a clus- 
ter (from the relatively economical to mega-power- 
ful). The session will include gotcha's and 
workarounds for smoothly clustering SQL Server 
Integration Services. We'll also cover some tips and 
tricks that will keep your clusters running smoothly 
without constant attention from you. 


SDB203: ARE YOU MISCONFIGURED? 
ANDREW KELLY 


Do you know what options you should change or set 
when installing or configuring a SQL Server 
instance? Is your memory set correctly? How about 
your disk subsystem? What about the placement 
and configuration of the database files? Is your sys- 
tem even scalable? If you aren't sure what you are 
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supposed to touch or why, you need to attend this 
session. We will cover the common configuration 
mistakes with SQL Server and the underlying server. 
There is no “one setting suits all" so we will explore 
when it is appropriate to change a setting from the 
default and why and how we choose a particular set- 
ting. Getting the settings correct may become much 
harder as the database grows in size and complexi- 
ty-let's get it right the first time. 


SDB304: GETTING THE MOST OUT OF THE 
SQL SERVER PROFILER 2005/2008 
BRAD MCGEHEE 


One of the most powerful tools available to the SQL 
Server DBA is SQL Server Profiler. While many DBAs 
are familiar with the fundamentals of this tool, they 
often lack a complete understanding of how they 
can use it to identify and troubleshoot many differ- 
ent types of SQL Server problems. In this session, 
attendees will learn specific techniques that they 
can apply to solving common SQL Server problems. 
These include: slow performing queries, blocking, 
deadlocking, sort warnings, excessive auto stats 
activity, excessive stored procedure compilations, 
excessive table/index scans, and SQL Server Profiler 
best practices. 


SDB305: ESSENTIAL DATABASE 
MAINTENANCE 
KIMBERLY L. TRIPP & PAUL S. RANDAL 


In this session, Paul and Kimberly will run you 
through their top-ten database maintenance recom- 
mendations, with a lot of tips and tricks along the 
way. These are distilled from almost 30 years com- 
bined experience working with SQL Server cus- 
tomers and are geared towards making your data- 
bases more performant, more available, and more 
easily managed (to save you time!). Everything in 
this session will be practical and applicable to a 
wide variety of databases. Topics covered and myths 
debunked include: backups, shrinks, fragmentation, 


statistics, and much more! Focus will be on 2005 but 
we'll explain some of the key differences for 2000 
and 2008 as well. 


SDB306: HOW TO INTERPRET QUERY 
EXECUTION PLANS IN SQL SERVER 
2005/2008 

BRAD MCGEHEE 


One of the black arts of being a DBA is how to read 
and interpret Graphical Query Execution Plans. This 
is a key thing to understand as Execution Plans pro- 
vide valuable clues as to why a particular query may 
be running slowly. In this session, you will learn how 
to read an Execution Plan, and learn what to do with 
the information you have gained from reading it. 


SDB307: MAXIMIZING PLAN RE-USE 
IN SQL 2008 
ANDREW KELLY 


Lack of plan reuse is one of the biggest performance 
killers in SQL Server and almost everyone has expe- 
rienced problems in this area before. We will explore 
exactly how to determine if this is an issue for you 
and more importantly, how to address it. See what 
factors determine if a plan gets reused or not and 
why. We will cover how to issue calls to the database 
that guarantee reuse and peak performance. 
Understanding this aspect of SQL Server is some- 
thing every good DBA should be fully aware of and 
attending this session will get you the insight to get 
started immediately. 


SDB208: TIPS AND TRICKS FOR 
UPGRADING TO SQL SERVER 2008 
RONALD YENKO 


Many organizations are still in the process of 
upgrading from SQL Server 2000 to 2005. When 
looking at going to SQL Server 2008, you may have 
a decision to make-upgrade directly from SQL 2000 
to SQL 2008-or-upgrade to SQL 2005 first, then to 


2008? In this session, we'll look at factors such as 
incompatibility issues (e.g. deprecated functionality, 
security models, etc), choosing the appropriate 
upgrade mechanism, and rollback planning. These 
can help you chose the best upgrade path for your 
organization. Like so many other things in life, tim- 
ing is everything. A little strategic evaluation and 
planning on your part could result in a 2-for-1 
upgrade process-saving you both time and money. 
t could also result in you saving your company from 
a costly situation in attempting to upgrade to a ver- 
sion your environment for which it is not ready. Most 
of the evaluations and processes would also apply 
to a SQL 2005 to SQL 2008 migration. 


SDB309: MASTERING THE SQL SERVER 
2008 RESOURCE GOVERNOR 
BRAD MCGEHEE 


For years, | have seen many, many questions in 
forums asking how individual queries or users 
could be restricted from taking more than their 
fair share of server resources. Until SQL Server 
2008, this was not possible. But now, with the help 
of the new SQL Server 2008 Resource Governor, 
DBAs have the ability to allocate SQL Server 
resources among connections. In this session, we 
will learn about the benefits and features of the 
Resources Governor, take a look at its architecture, 
and learn how to configure and implement it. We 
will also take a look at best practices. 


SDB210: TIPS AND TRICKS FOR AUDITING 
IN SQL SERVER 
RONALD YENKO 


SQL Server 2005 introduced tools to help you audit 
what was occurring in the structure of your data- 
base (e.g. DDL triggers). SQL Server 2008 is intro- 
ducing even more auditing tools-including auditing 
of data changes and even reads. If you were to audit 
everything possible, your system would likely 
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expend more resources auditing than serving cus- 
tomers. In this session, we'll go over the questions 
you need to ask your business to determine what 
level of auditing is appropriate. Then we'll go 
through how to set up many of the common audits 
to meet your business’ requirements. 


SDB311: SAY NO TO MAINTENANCE PLANS 
ANDREW KELLY 


The built in Maintenance Plans are OK to get up and 
running in a hurry but they are far from ideal. There 
are inherent limitations with the implementation 
and in the event there is a problem, troubleshooting 
can be almost impossible. This session will cover in 
detail a set of stored procedures that you can use to 
create your own custom maintenance jobs. You will 
have the flexibility to modify them to suite your 
every need far easier than the Maintenance Plans 
ever could. And since these utilize pure T-SQL they 
are easy to maintain and far easier to troubleshoot 
than the "black boxed" built in maintenance plans. 
Creating your own custom jobs is fast and as a 
result you will have a much better understanding of 
what is being done by each task putting you in a bet- 
ter position to effectively troubleshoot any prob- 
lems that may arise. 


SDB412: DBCC CHECKDB: 
THE DEFINITIVE GUIDE 
KIMBERLY L. TRIPP & PAUL S. RANDAL 


Detecting corruption is critical to limiting down-time 
and data-loss, and DBCC CHECKDB is the way to do it. 
However, to most people it's a black-box tool that 
eats system resources, takes a long time to run, and 
spits out cryptic output. How does it work internal- 
ly? What does it do? When should it be run? What 
does the output mean? Paul wrote DBCC CHECKDB 
for SQL Server 2005 and can explain the answers to 
all these questions. Come to this session to see 
DBCC CHECKDB demystified by the author of the 
code. Although this session is only an hour, Paul and 
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Kimberly will stay through lunch for an open Q&A-so 
go grab your boxed lunch and come back to keep lis- 
tening and learning! 


SDB313: FOLLOW THE RABBIT: 
INTERACTIVE Q&A ON DATABASE 
MAINTENANCE 

KIMBERLY L. TRIPP & PAUL S. RANDAL 


If there's something you want to know about 
Database Maintenance, we've got the answer for 
you! During the week there have been sessions on 
many aspects of database maintenance, but maybe 
YOUR question hasn't been answered. So, bring 
along your questions as we discuss the ins and outs 
of keeping a database healthy. This session might 
not seem as structured as other sessions, but you'll 
be surprised at how informative and fun it is! This 
follows straight on from the DBCC CHECKDB session, 
plus open lunchtime Q&A-we've had such great suc- 
cess with these Q&A sessions that we want to maxi- 
mize your time in them. 


SDB414: PERFORMANCE TUNING USING 
X/EVENTS 
GERT DRAPERS 


When it comes to performance tuning, you want all 
the insights possible in to what SQL Server is doing. 
X/Events is the tooling that will provide you that 
insight. Not only does it provide session-level infor- 
mation about wait states, resource utilization, locks 
etc., it also allows you to correlate this information 
with the operating system. This enables the experi- 
enced performance troubleshooter and tuner to 
identify the bottlenecks inside SQL Server much 
more efficiently. This session will teach you how to 
use X/Event to become an effective performance 
troubleshooter and tuner. 


SQL SERVER DEVELOPMENT 


SDV401: USER-DEFINED TYPES AND 
AGGREGATES IN SQL SERVER 2008 
DON KIELY 


Running .NET code within SQL Server 2008 has 
opened up a lot of amazing possibilities, providing 
flexible options for working with relational data. But 
defining your own user-defined types and aggre- 
gates is easily the most complex and powerful thing 
you can do with SQLCLR code. That power and com- 
plexity puts off some developers, but you shouldn't 
miss out! SQL Server 2008 expands UDTs in great 
new ways, making it all the more important to know 
how to use them. In this session, we'll explore how 
to create custom types that perform well, write 
attributes correctly, and use the right serialization 
formats. We'll also talk about issues you should con- 
sider when designing your own types, as well as 
when it might be better to use other options. 
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SDV302: GROUPING SETS AND MERGE IN 
SQL SERVER 2008 
ITZIK BEN-GAN 


SQL Server 2008 introduces several important new 
T-SQL features, among them enhanced support for 
grouping sets and the MERGE statement. The 
enhanced support for grouping sets allows you to 
develop more flexible and efficient applications that 
support the growing demands for dynamic analysis 
of aggregated data. The MERGE statement allows 
combining INSERT, UPDATE and DELETE logic as a 
single atomic operation to merge contents of a 
source into a target. This session will cover both 
enhancements in detail and demonstrate some of 
their practical uses. 


SDV303: INDEX INTERNALS AND USAGE 
KIMBERLY L. TRIPP & PAUL S. RANDAL 


Indexes are arguably the most important structures 
in a database yet they are often poorly understood 
and neglected. In this session, you'll be reminded of 
the internals of indexes but our focus will be on how 
they are used by the SQL Server engine and what 
you need to do to make sure they're kept in opti- 
mum health. A myriad of tips, tricks, and optimiza- 
tions will be discussed and demo'd so that you 
improve performance immediately. 


SDV304: SECURITY IN THE CLR WORLD 
INSIDE SQL SERVER 
DON KIELY 


One of the major benefits of writing .NET code to 
run in the Common Language Runtime in any envi- 
ronment is its code access security (CAS). CAS pro- 
vides a code-based-rather than user-based- 
authorization scheme to prevent various kinds of 
luring and other code attacks. But how does that 
security scheme co-exist with SQL Server's own, 
greatly enhanced security features? By default 
your .NET code is reasonably secure, but it is all too 
easy for the two security schemes to butt heads 
and cause you grief. During this session, we'll 
briefly look at the concept behind CAS, then 
explore how to make it work for you instead of 
against you as you take advantage of these 
advanced programming features in SQL Server. 


SDV305: T-SQL TIPS AND TRICKS 
ITZIK BEN-GAN 


This session will cover T-SQL tips and tricks. It will 
demonstrate how to solve common T-SQL problems 
elegantly and efficiently. The session will cover 
techniques in Microsoft SQL Server 2005, and will 
also introduce tips and tricks that involve new fea- 
tures and enhancements in Microsoft SQL Server 
2008. The purpose of the session is both to demon- 
strate advanced techniques, but also to have some 
fun with T-SQL. 
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SDV306: HANDLING GRAPHS, TREES 
AND HIERARCHIES IN SQL SERVER 2005 
AND 2008 

ITZIK BEN-GAN 


Graphs are specialized data structures that repre- 
sent relationships between pairs of items. Examples 
for graphs include an Employee Organizational 
Chart and a Bill of Materials. This session explains 
how to query graph data stored in SQL Server to 
answer common requests, including: 
m Subgraph, e.g., return all subordinates 
of a given manager 
m Path, e.g., return all management chain 
of a given employee 
m Presentation, e.g., sort employees such 
that a subordinate would be returned 
after a manager 


This session will explain how to handle such 
requests with recursive queries in SQL Server 2005 
and also with the new HIERARCHYID datatype intro- 
duced in SQL Server 2008. 


SDV407: UNDERSTANDING SQL SERVER 
MEMORY MANAGEMENT 
GERT DRAPERS 


There are three key things to understand when it 
comes to SQL Server scalability and performance: 
execution, 1/0 and memory. This session will take you 
through the internals of SQL Server memory man- 
agement in order to gain the necessary knowledge 
to better understand the underlying SQL Server 
behaviors. Once you understand how SQL Server 
allocates and uses its memory, you will increase your 
effectiveness when dealing with performance tuning, 
scaling, and configuration problems. 


SDV308: WHAT'S NEW, HARDER, AND 
EASIER IN SQL SERVER 2008 SECURITY 
DON KIELY 


Each new version of SQL Server has gotten more 
secure and more complex. More secure is better, but 
more complex means that there are likely to be 
whole new ways of attacking it that no one has 
dreamed up yet. During this session, we'll see what's 
new in security and how it makes development eas- 
ier and harder. Overall your applications are likely to 
be more secure, but you'll need to know more than 
ever about security to make it so. 


SDV409: UNDERSTANDING THE 
SQL SERVER EXECUTION MODEL 
GERT DRAPERS 


There are three key things to understand when it 
comes to SQL Server scalability and performance: 
execution, 1/0 and memory. This session will take you 
through the internals of the SQL Server execution 
and scheduling system. This will provide you with the 
necessary data to better understand the underlying 
SQL Server behaviors and enables you to better trou- 
bleshoot your performance and scaling challenges. 


BUSINESS INTELLIGENCE 


SBI201: UNCONVENTIONAL ETL WITH 
INTEGRATION SERVICES 
STACIA MISNER 


The term ETL is typically associated with traditional 
data warehousing in which common data sources 
are flat files or relational databases, but so much 
more is possible with SQL Server 2005 Integration 
Services. In this session, we'll explore some data 
integration scenarios that could be added to your 
ETL repertoire. This session shows you how to go 
beyond traditional relational or flat file sources by 
using SSIS to extract from XML data and free-form 
text and integrate the results into your analytical 
applications. You'll also discover that loading data 
into relational destinations is no longer your only 
option for preparing data for reporting applications. 


SBI202: OPPORTUNITIES FOR DATA 
PROFILING WITH INTEGRATION 
SERVICES 2008 

STACIA MISNER 


Performing data profiling is a labor-intensive and 
time-consuming task that is a process ideal for 
automation. The new Data Profiling Task in 
Integration Services 2008 allows you to put high- 
quality data into new sources in data integration 
projects, ensure quality is maintained by imple- 
menting data quality projects, and explore data in 
data mining projects. Come to this session to learn 
the features of the Data Profiling Task and how to 
use the Data Profile Viewer application. In addition, 
you will learn how to query the output of the Data 
Profiling Task in the control flow of a package. 


SBI203: WHAT'S SO GREAT ABOUT 
REPORTING SERVICES 2008? 

STACIA MISNER 

Reporting Services gets a major overhaul in SQL 
Server 2008. In this session, we will focus on how to 
use the new report development features that solve 
challenging report layout problems. We will also 
show how to use the new charting and gauge capa- 
bilities to properly display quantitative data. 


SBI304: FOLLOW THE RABBIT: 
INTERACTIVE Q&A ON ANALYSIS 
SERVICES PERFORMANCE 
STACIA MISNER 


The focus of this discussion is how to adjust data- 
base design and server tuning to help you get bet- 
ter performance from your Analysis Services solu- 
tion. There will be only 5-10 slides covering best 
practices to get the conversation started, but most 
of the session time is open for your questions. Come 
participate in this session for an informative and 
interactive experience that will give you practical 
advice to put into practice in your own environment. 


SSWUG 


SSWUGO1: STARTING A NEW DBA POSITION 
CHRIS SHAW 


Starting a new job can be one of the most stressful 
times of your life. This is magnified by the fact that 
the work you complete in the first 30 days may be 
used as an indicator of how well you are going to 
succeed at the company. Yet everyone has to start a 
new position at least once. So how do you make sure 
that you hit the ground running and you make that 
good impression? 


SSWUGO2: INTRODUCING THE SQL 
SERVER PERFORMANCE DATA COLLECTOR 
TED MALONE 


SQL Server Administrators have long asked for tools 
to make performance baselining and tuning easier. 
In SQL Server 2005, Microsoft introduced a series of 
System views and functions that took a huge step 
towards that, and in Service Pack 2, they introduced 
a series of add-on reports to help make the job eas- 
ier. In SQL Server 2008, Microsoft has introduced an 
entire framework to allow administrators to collect 
relevant and actionable performance information. 
This session will introduce the Performance Data 
Collector, and show how it can be used to assist 
DBAs and developers alike. 


SSWUGO3: ANALYSIS SERVICES DEEP DIVE 
TED MALONE 


This session presents SQL Server Analysis services 
best practices and advanced techniques from both 
the developer and administrator perspectives. This 
session focuses on the real-world application of best 
practices for infrastructure and security design, 
cube design, aggregation design, performance tun- 
ing and solution deployment. During the session, 
attendees will gain insight into a real-world Business 
Intelligence product development and deployment. 


SSWUGO4: SOX LESSONS LEARNED 
CHRIS SHAW 


Let me share with you the lessons that | have 
learned by going through one of the most in-depth 
audits | have ever done. We will cover why these 
audits are being done and what we need to do to 
avoid being on the hit list. | will spend time talking 
about the auditors and what they are looking for. | 
will share with you the ways that | have been able to 
mitigate major discrepancies that they have found 
and why they worked the way they did. | can show 
you the documents that they need and the docu- 
ments gotcha's that you should avoid. Even if you 
are not a publicly held company, I think it's only a 
matter of time before non-profits start to have to 
answer to the same audit standards. 


55110605: INTEGRATION SERVICES 
DEVELOPMENT BEST PRACTICES 
MATTHEW ROCHE 


Are you tired of feeling like you're making the same 
mistakes over and over again? Would you like to have 
a roadmap that outlines the pitfalls you're likely to 
encounter when building ETL solutions with SSIS? 
Then this session is for you! You'll learn how to get 
the most from the SSIS tools and platform through a 
Set of SSIS development best practices from a battle- 
scarred database and BI consultant who has sur- 
vived the rough projects and lived to tell the tale. 


SSWUGO6: SQL SERVER INTEGRATION 
SERVICES PERFORMANCE TUNING AND 
OPTIMIZATION 

MATTHEW ROCHE 


SSIS packages have many capabilities, from control 
flow to event handlers to scripting. But the SSIS data 
flow is where the decisions you make will have the 
greatest impact on the performance of your pack- 
ages. In this session, you'll learn what's going on 
under the hood in the SSIS data flow pipeline, and 
how to take advantage of that knowledge to make 
your packages perform better. You'll also learn gen- 
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eral tips and tricks to improve SSIS package per- 
formance and how to get the most out of your pack- 
ages. 


SSWUGOT: PLAN GUIDES 
JEREMY LOWELL 


In SQL Server 2008, there exists a way to change or 
create a new plan for a query without touching the 
query itself.In environments where the database was 
provided by a third-party or in a high availability 
environment, these will help to decrease your impact 
on production systems while improving performance 
at the same time. Over the course of the session, we 
will walk through the creation of a plan guide. 


55110608: AGILE BUSINESS 
INTELLIGENCE 
TED MALONE 


Many business intelligence projects are grown from 
in-house requirements and take on a life of their 
own. Many times when developers think about ВІ 
projects, they tend to classify them as non-standard 
development projects and don't apply typical engi- 
neering practices. This session will discuss how Agile 
methodologies are a perfect fit for Business 
Intelligence projects. This session uses a case-study 
approach, modeling a successful real-world ВІ proj- 
ect that was built using Agile methodologies. 


SSWUGO9: POLICY MANAGEMENT 
JEREMY LOWELL 


Developers and DBAs alike can now enforce naming 
conventions at the database with policy-based man- 
agement. There are many other types of policies that 
can be created and evaluated in SQL Server 
2008.This new management tool will allow the devel- 
oper and DBA to spend less time checking on things 
and more time creating and managing them at an 
environment level versus a database by database 
level. This session will show examples of how to cre- 
ate and evaluate policies. 
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BUSINESS INTELLIGENCE AND 
SHAREPOINT 


HBI101: 10 THINGS YOU NEED TO KNOW 
ABOUT PERFORMANCEPOINT SERVER 
MAURO CARDARELLI 

PerformancePoint Server is the perfect tool for 
extending your SharePoint investment into hard- 
core Business Intelligence. Since PerformancePoint 
is so big and powerful, how do you get started with 
it in your organization? This session will help you 
jump with both feet in by walking you through the 
top 10 things you need to know about PPS and how 
each can add business value to your company. This 
session will include several demonstrations and 
offers the SharePoint gurus a great first step into 
the world of ВІ. 


HBI301: CONNECTING TO YOUR ORACLE 
DATA WITH SHAREPOINT 

MAURO CARDARELLI 

Has your organization invested in MOSS for a cor- 
porate intranet but still has business critical data 
in Oracle? This session will show you how to bridge 
the two by bringing in your Oracle data into 
SharePoint. Whether it is simple reporting or more 
complicated bi-directional updates, this session 
will get the SharePoint and Oracle folks in your 
company working together to build the next wave 
of powerful business user tools. Numerous demon- 
strations and code snippets will be shared. 


HBI302: BUILDING A SALES PIPELINE 
APPLICATION WITH REPORT CENTER 
MAURO CARDARELLI 

Have you started using Report Center? Did you 
know that you can use it for things like managing 
a sales pipeline or broker services? This session 
will walk you through building both. It will also 
include steps for creating basic reports and KPls 


using Report Center data. Whether you are new to 
Report Center or a seasoned pro, this session will 
allow you to walk away with action items for tak- 
ing your implementation to the next level. 


DEPLOYMENT, ADMINISTRATION, 
OPERATION, AND OPTIMIZATION 
OF SHAREPOINT 


HBI303: INTRODUCTION TO MOSS 
ADMINISTRATION 

MICHAEL BLUMENTHAL 

Learn the ABCs of MOSS administration: 
Application Pools, Backups, Central Administration, 
and an alphabet soup of other concepts including 
the five S's of SharePoint: Sites, Site Collections, 
Service Accounts, Server Monitoring, and STSADM, 
as well as Web Applications, Features and 
Solutions, Policies, Quotas, and more! Oh my! 


HBI304: SITE PROVISIONING SOLUTIONS 
MICHAEL BLUMENTHAL 

Are you stuck between not allowing any users to 
create sites and not wanting to burden IT with cre- 
ating them? This session is for you! I'll discuss a 
middle ground where the user submits a request 
for a site, approvals are requested, and if all the 
approvals are met, the request is created. 


FORMS AND WORKFLOW 
WITH SHAREPOINT 


HFW301: CONVERT YOUR EXISTING WORD 
AND EXCEL FORMS TO INFOPATH 

ASIF REHMANI 

If your corporation is like most, you probably 
have at least a dozen or so electronic forms that 
have been created using Microsoft Office Word or 
Microsoft Office Excel. Wouldn't it be nice to be 
able to publish these forms directly to your 


SharePoint site and have your users fill them out 
using their browsers? In this session, you will 
first see how you can convert your existing Word 
or Excel forms to InfoPath forms. Then you'll 
learn how to implement information from exter- 
nal data sources and client-side validation logic 
in these forms. Lastly, you'll see how to publish 
the forms onto a SharePoint site for easy access 
by the users. 


HFW302: DESIGN POWERFUL WORKFLOWS 
WITH SHAREPOINT DESIGNER 

ASIF REHMANI 

Workflows are essential to business processes. 
The ability to route a document or an item 
through multiple stages, gathering feedback and 
approval from multiple people, is a routine proce- 
dure in many companies. Now you can take advan- 
tage of SharePoint's built-in support for workflows 
to design powerful multi-step workflows. In this 
session, you will first see how to make use of the 
built-in workflows directly through SharePoint's 
browser interface. Then, you will see how to devel- 
op multi-step powerful workflows-without code- 
using Microsoft Office SharePoint Designer 2007. 


HFW303: SIGN YOUR INFOPATH 
ELECTRONIC FORMS USING DIGITAL 
SIGNATURES AND PUBLISH 

TO FORMS SERVER 

ASIF REHMANI 

So you think that you can go completely digital 
and eliminate paper altogether from your organi- 
zation? Where would you store these forms? How 
about collecting signatures from people? No wor- 
ries! In this session, you will see how you can dig- 
itally sign your Microsoft Office Infopath 2007 
electronic forms and then publish them to the 
Forms Server in SharePoint to be served up to 
your users through any browser. 
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HFW304: ADDING CODELESS WORKFLOWS 


TO INFOPATH FORM SOLUTIONS 
DAVID GERHARDT 


Deploying a Microsoft Office InfoPath 2007 form 
template to SharePoint provides users with a reli- 
able mechanism for collecting data. When work- 
flow is added to the mix, users get a robust solu- 
tion that automates common tasks. This session 
identifies how you can integrate codeless work- 
flows into SharePoint form solutions. 


HFW305: DEVELOPING INFOPATH BROWSER 
FORMS FOR SHAREPOINT 

DAVID GERHARDT 

The Microsoft Office InfoPath 2007 "design once" 
concept allows you to use a single form template 
in rich client and browser scenarios. However, 
there is a reduced set of InfoPath functionality 
available for browser forms. This session explains 
some of the limitations in working with InfoPath 
Forms Services and discusses ways to optimize 
browser forms using out-of-the-box and managed- 
code techniques. 


HFW306: DEVELOPING INFOPATH CLIENT- 
ONLY FORMS FOR SHAREPOINT 

DAVID GERHARDT 

Microsoft Office InfoPath 2007 has a powerful 
designer that offers a wide selection of controls 
and features for SharePoint form solutions. It also 
includes an event framework that provides devel- 
opers options to extend form functionality with 
managed code. This session explores many of the 
InfoPath designer capabilities and examines ways 
to address challenges that arise when deploying a 
form template to SharePoint. 


MOSS SEARCH 


HSE301: CUSTOMIZING SEARCH CENTERS 
TO SUPPORT SEARCH SERVER 2008 
DANIEL WEBSTER 
Ensuring that the search result set has high rele- 
vance is always the focus of search design. This ses- 
sion covers the design topics inherent in developing 
a robust, customized search center topology. This 
session will focus on creating a customized MSS 
end-user experience that enhances the presenta- 
tion and findability of content items in a result set 
without writing code. Like Microsoft Office 
SharePoint Server 2007, MSS effectively divides 
management tasks among farm administrators, 
search administrators, and site collection adminis- 
trators. The abilities of site collection administrators 
to customize search for their users may change 
your search topology design. Considerations in your 
design will include: 

m Activate MSS for the site collection 

m Create Search Centers for site collections 


m Search scopes for the site collection 
m Keywords and best bets for the site collection 
= Indexing of sites, lists, and libraries 
We will review design considerations for: 
= Centralized Search Center 
= Decentralized Search Center 
m Hybrid design 


HSE102: HOW MICROSOFT SEARCH SERVER 
2008 EXPANDED SEARCH IN SHAREPOINT 
SERVER 2007 

DANIEL WEBSTER 

Microsoft introduced a new search product that 
you can use to upgrade and enhance the search 
capabilities of Windows SharePoint Service 3.0. 
Microsoft released a licensed version of this prod- 
uct, Microsoft Search Server 2008 (MSS), in early 
2008, along with a free version, Microsoft Search 
Server 2008 Express (MSSX). You can integrate 
this exciting new product into SharePoint Server 
2007 for free. It extends the search capabilities 
and will cause you to re-think your search topolo- 
gy design. 


HSE303: USING FEDERATED LOCATION 
DEFINITIONS AND LEVERAGING LIVE.COM 
WITH SEARCH 
DANIEL WEBSTER 
Microsoft Search Server 2008 introduced federat- 
ed queries that provide the ability to forward 
user's search terms to external search engines 
concurrently with queries to its own index. The 
topics in this dicussion include: 

m OpenSearch 11 

m Federated queries 

m FLD files 

= Installation of available FLDs 

= Create custom FLD files 
Microsoft has implemented a solid integration 
between Live.com and MSS. This session will demon- 
strate how to extend the federated query technolo- 
gy with Live.com to create a customized, highly rel- 
evant result set for your end users. The topics we'll 
discuss include: 

= Create Live.com accounts 

= Live.com basic and advanced features 

= Build federated queries that integrate with 

Live.com 


HSE304: MOSS SEARCH: IMPROVING 
RELEVANCE AND THE SEARCH EXPERIENCE 
USING THE API 

ERIK MAU 

The out-of-the-box search experience can be 
improved by tapping into the API available for 
search. This session takes an in-depth look at the 
search АРІ and introduces patterns that сап be 


applied to strengthen both the search user expe- 
rience and search relevance. 


HSE305: MOSS SEARCH: LEVERAGING YOUR 
INVESTMENT IN THE PLATFORM 

ERIK MAU 

SharePoint 2007 provides a powerful search 
engine that is often underutilized. This session 
provides a deep dive into the out-of-the-box capa- 
bilities the platform provides. It will cover both 
search administration and user experience prac- 
tices that will help you unlock the full potential of 
the platform. 


HSE306: MOSS SEARCH: UNIFYING 
BUSINESS DATA AND DOCUMENTS 

ERIK MAU 

SharePoint's Business Data Catalog feature pro- 
vides the ability to integrate your business data 
into the SharePoint platform. By leveraging the 
SharePoint search framework, we can provide 
another entry point into your user's business 
applications. This session focuses on how to incor- 
porate the out-of-the-box capabilities with cus- 
tomizations that use the search API. 


SHAREPOINT ARCHITECTURE AND 
CAPACITY PLANNING 


HAR201: INFORMATION ARCHITECTURE 

FOR A MOSS INTRANET 

MICHAEL BLUMENTHAL 

So you've built your MOSS server farm. You now 
have all the infrastructure in place to host your 
first user-facing site, and it's the corporate 
intranet. What now? In this session, I'll provide 
guidance through the critical decision of picking 
your root site template, Web application naming 
issues, site collection planning, and how to organ- 
ize the content on your site. Learn how to inte- 
grate needs for publishing, collaboration, and 
applications into one consistent user experience. 


HAR302: ARCHITECTING A HIGHLY 
REDUNDANT SHAREPOINT 2007 FARM 
MICHAEL NOEL 

This session covers best practice design and plan- 
ning for setting up a highly redundant Office 
SharePoint Server 2007 environment. Technologies 
such as Network Load Balancing of SharePoint Web 
front ends and Application servers are covered in 
depth, and tips and tricks for the deployment of 
redundancy in a SharePoint environment are pre- 
sented. In addition, specifics on how to leverage 
SQL Server 2005 Database Mirroring technologies 
for remote data replication of SharePoint content 
databases is covered and demonstrated in detail. 
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HAR303: BUILDING THE PERFECT 
SHAREPOINT FARM: A WALKTHROUGH OF 
BEST PRACTICES FROM THE FIELD 
MICHAEL NOEL 

SharePoint 2007 has proven to be a technology 
that is remarkably easy to get running out of the 
box. On the flipside, however, some of the 
advanced configuration options with SharePoint 
are notoriously difficult to set up and configure, 
and a great deal of confusion exists regarding 
SharePoint best practice design, deployment, dis- 
aster recovery, and maintenance. This session cov- 
ers best practices encompassing the most com- 
monly asked questions regarding SharePoint 
infrastructure and design, and includes a broad 
range of critical but often overlooked items to 
consider when architecting a SharePoint environ- 
ment. In short, all of the specifics required to build 
the "perfect" SharePoint farm are presented 
through discussion of real-world SharePoint 
designs of all sizes. 


HAR304: VIRTUALIZING SHAREPOINT 
COMPONENTS 

MICHAEL NOEL 

Server virtualization technologies have taken front 
stage recently and many organizations have begun 
to seriously contemplate replacing physical 
servers, including SharePoint servers, with virtual- 
ization technologies. This session focuses on real- 
world architecture and best-practice recommenda- 
tions for incorporating SharePoint architecture 
into virtualized environments running with either 
Microsoft's Virtual Server 2005, Microsoft's 
Windows 2008 Hyper-V Virtualization, EMC's 
VMware Server, and Citrix XenApp products. The 
session focuses on outlining which specific com- 
ponents of SharePoint operate well in a virtualized 
environment versus which ones are not necessari- 
ly good candidates. In addition, this session gives 
an in-depth look at real-world designs for 
SharePoint using both major virtualization prod- 
ucts and outlining the strengths and weaknesses 
of each product in relation to SharePoint function- 
ality and supportability. 


SHAREPOINT CUSTOMIZATION 


HCS301: AUTOMATING COMMON 
SHAREPOINT TASKS WITH POWERSHELL 
NEIL IVERSEN 

Why let the Exchange administrators have all the 
fun? PowerShell can provide a scriptable interface 
into SharePoint to get rid of repetitive tasks or 
troubleshoot a problem. You can use PowerShell to 
simplify common tasks like deployments, manage 
site permissions or even move documents in a doc- 
ument library. You can even move a site from a 
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development to production without touching the 
Ul. This session will help you effectively use 
PowerShell in your own environment. 


HCS202: EFFECTIVELY USING FEATURES 
AND SOLUTIONS 

NEIL IVERSEN 

Features provide the foundation for adding your 
customizations to SharePoint. Solutions form the 
package that can contain many features and files 
to deploy to your entire farm. Together, these two 
provide the ability for you to create redeployable 
packages for SharePoint, but you need to know 
how to use them effectively.Learn how to use them 
to manage change between your different environ- 
ments and promote code and changes through a 
change control process. 


HCS403: PACKAGING YOUR ADVANCED 
SHAREPOINT CUSTOMIZATIONS 

NEIL IVERSEN 

SharePoint provides a set of features for com- 
mon customizations, but what about ones that 
are left out? How can you deploy a custom field, 
policy or event handler? What if you have content 
that isn't even stored in SharePoint? Is it possi- 
ble to deploy a SQL database? Should you? 
Answering these questions requires a detailed 
look at how customizations are deployed and 
their lifecycle and dependencies. This session 
will enable you to create packages to solve your 
deployment problems. 


HCS304: INTEGRATING ACCESS 

AND SHAREPOINT 

TY ANDERSON 

This session will drill into the development fea- 
tures of Microsoft Access as they relate to 
SharePoint. Several demos will be provided show- 
ing how to utilize Microsoft Access as the front-end 
to SharePoint-based solutions. Coverage of man- 
aged Microsoft Access applications using VSTO will 
be included as well. At the end of this session, the 
attendee will understand how to integrate 
Microsoft Access with SharePoint to deliver solu- 
tions within their organization. 


HCS305: OUTLOOK AND SHAREPOINT 
USING LINQ TO SQL 

TY ANDERSON 

Learn how to integrate SharePoint data with 
Outlook using LINQ to SharePoint. | will explain 
how to utilize VSTO and LINQ to build an Outlook 
add-in that automates a common business 
process. Attendees will gain an understanding of 
how to work with SharePoint sites and lists using 
LINQ as well as how to incorporate the data with- 
in the Outlook data store. 


HCS306: BUILDING CUSTOM WORKFLOWS 
WITH VSTO 

TY ANDERSON 

Learn how to build and publish custom SharePoint 
workflows using Visual Studio Tools for Office 
(VSTO). You'll see how to build both sequential and 
state-machine workflows as well as how to deploy 
them to SharePoint. 


SHAREPOINT FOR ENTERPRISE 
CONTENT MANAGEMENT 


HEC301: CREATING AND DEPLOYING A 
CUSTOM DOCUMENT CONVERTER FOR 
SHAREPOINT 2007 

PAUL STORK 

A lot of the information used in organizations 
today is stored as unstructured content in files 
like Word documents. In this session, we will exam- 
ine one of the external services available in 
SharePoint's Web Content Management Features 
that can make this unstructured content more 
easily accessible. Using the Document Converter 
services in SharePoint we can take existing con- 
tent stored in Word 2007 documents and automat- 
ically convert it to a published Web page. But what 
if your content is stored in older Word documents 
or some other unsupported format? We will also 
look at how document conversion can be extend- 
ed by creating and deploying new Document 
Converters that expand on the four formats that 
ship with SharePoint. 


HEC302: DEPLOYING CONTENT AND 
INFRASTRUCTURE IN A WEB CONTENT 
MANAGEMENT ENVIRONMENT 

PAUL STORK 

Content Deployment in Microsoft Office SharePoint 
Server can be used to automate the deployment of 
content in a Web Content Management environ- 
ment.It can be used to develop an automated two- or 
even a three-tier environment where content is auto- 
matically deployed through the various tiers even if 
they are on different SharePoint Farms. But that's 
only half of the story. Because Content Deployment 
only moves content stored in the SharePoint data- 
bases. What about infrastructure components like 
Web Parts, content types, list templates, and even 
custom master pages? You can use a combination of 
Features and Solutions to automate deployment of 
infrastructure components. This session will discuss 
how to develop a parallel environment where con- 
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tent is moved from an authoring site to a staging site 
and then to production using Content Deployment. 
Meanwhile, infrastructure components are deployed 
using a combination of Features and Solutions from 
a development environment where they are created, 
a testing environment where they are tested, to a 
production environment. This combination of 
Content Deployment, Features, and Solutions will 
provide you with a truly manageable enterprise 
SharePoint installation. 


HEC303: DEVELOPING PRINTABLE 


SHAREPOINT PAGE LAYOUTS USING CSS 
PAUL STORK 

Have your users ever complained because your 
SharePoint sites aren't easily printable? In this ses- 
sion, we'll examine how to build a custom 
Cascading Style Sheet that will be used by pages in 
your site as a printing layout. By designating a 
printing style sheet in your master page you can 
define a printable view of your pages that strip out 
elements that aren't necessary when printing a 
page, like navigation bars, menu buttons, and 
search boxes. You can also define a layout that is 
sized appropriately for a printed page. Learn how 
to make SharePoint more than just an online col- 
laborative environment by making it easy to take a 
quick hard copy snapshot of a site. 


HEC204: FIVE SHAREPOINT FRIENDS IN AN 
ECM WORLD 

SAHIL MALIK 

In this session, Sahil walks you through five 
SharePoint concepts that you will apply repeatedly 
in any ECM delivery. Using these five concepts, 
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Sahil will demonstrate Records Management, 
Records Policies, Offline storage, metadata moni- 
toring, and effective search. 


HEC305: LARGE OBJECT STORAGE 

IN SHAREPOINT 

SAHIL MALIK 

Y'all, this is a big problem! How exactly can you 
store large documents inside of SharePoint? By 
large, | mean over 26B in size. And when you do 
store such documents, how exactly does it work 
inside the SharePoint Ul, how does search work, 
and how does SharePoint work? The beauty of any 
Microsoft platform is its extensibility. | guess it's 
beauty we will have to rely on after all. 


HEC306: WHY CONTENT TYPES 

ARE YOUR FRIEND 

SAHIL MALIK 

Content types, we have all used them, we all like 
them. But they take a special meaning in an ECM 
project delivery. In this session, Sahil points out 
some very practical situations where content types 
present an elegant solution to common ECM tasks. 


SHAREPOINT SECURITY 
AND EXTRANETS 


HSC301: SHAREPOINT PERSONALITY 
DISORDER: FBA, ADFS, LIVEID, NTLM, 
KERBEROS, LDAP... EGAD... 

ROBERT GINSBURG 

Microsoft and other third parties have provided a 
myriad of authentication tools for authenticating 
users in SharePoint. However many of the differ- 


ent authentication schemes have corresponding 
authorization requirements? This session will 
focus on discussing the differences between a 
number of SharePoint authentication techniques 
and how to reconcile SharePoint content authori- 
zation, audit trails, and workflow roles, and the 
impact on archival content storage. 


HSC302: YOU WANT TO TRUST WHO? 
FEDERATED EXTRANET SCENARIOS AND 
SHAREPOINT 

(A CASE FOR AN IDENTITY FIREWALL) 
ROBERT GINSBURG 

Microsoft ADFS (and several other technologies) 
have come long way. However, many of them oper- 
ate against transient identities whose identity 
other SharePoint users cannot always understand. 
In this session, we will discuss the need for per- 
sistent identities, how to accomplish them, and 
how to protect your internal network resources 
with an "Identity firewall". 


HSC303: SHAREPOINT AND ILM-ACCOUNT 
MANAGEMENT ON STEROIDS 

ROBERT GINSBURG 

Out of the box, SharePoint provides a simple col- 
laborative system for creating Active Directory 
accounts. However these accounts are only creat- 
ed, not managed. When the business scenarios 
change, no one knows who still needs access and 
who should be restricted. In this session, we will 
discuss how to connect SharePoint and Microsoft 
Identity Lifecycle manager to provision Extranet 
access Active Directory accounts and link them to 
the life of content in the SharePoint store. 
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A LAP AROUND THE NEWEST FEATURES IN 
ASP.NET AND MICROSOFT VISUAL STUDIO 
2008 FOR WEB DEVELOPERS 
MICROSOFT 


AJAX PROGRAMMING WITH THE MICROSOFT 
AJAX TECHNOLOGIES 
MICROSOFT 


ADO.NET DATA SERVICES FOR THE WEB 
(A.K.A. PROJECT "ASTORIA") 
MICROSOFT 


Attend Microsoft ASP.NET, Visual Studio & .NET, or 
SharePoint Connections and attend the sessions of 
the SQL Server Connections conference for FREE! 


ASP.NET SERVER CONTROLS FOR MICROSOFT 
SILVERLIGHT, AJAX CONTROL TOOLKIT, AND 
ASP.NET AJAX 
MICROSOFT 


DEVELOPING WEB 2.0 WITH MICROSOFT 
INTERNET EXPLORER TOOLS 
MICROSOFT 


CAR OR MOTORCYCLE: CHOOSING THE ASP.NET 
MVC FRAMEWORK 
MICROSOFT 


BUILDING GREAT WEB APPLICATIONS WITH 
MICROSOFT SILVERLIGHT 
MICROSOFT 


BUILDING MICROSOFT SILVERLIGHT MEDIA 
APPLICATIONS 
MICROSOFT 
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AAR201: FROM ZERO TO N-TIER 
IN 75 MINUTES 
PAUL SHERIFF 


AAR202: BUILDING N-TIER ASP.NET 
APPLICATIONS WITH LINQ 
DAN WAHLIN 


ACS201: AJAXIFYING EXISTING APPS WITH 
THE ASP.NET AJAX EXTENSIONS 
PAUL LITWIN 


ACS202: USING JQUERY WITH ASP.NET 
RICK STRAHL 


ACS203: USING WCF FOR JSON AND REST 
SERVICES WITH ASP.NET 
RICK STRAHL 


ACS304: AJAX: CHALLENGES 
AND SOLUTIONS 
CHRISTIAN WENZ 


ACS405: OOP WITH/DESPITE JAVASCRIPT 
CHRISTIAN WENZ 


ADX201: DATA CONTROL TIPS AND TRICKS 
PAUL LITWIN 


ADX202: VIEWING DATA IN THE NEW 
DATA WORLD 
DAVE SUSSMAN 


ADX103: .NET 3.5 LANGUAGE FEATURES 
DAVE SUSSMAN 


AFR201: BUILDING SMART TAGS AND 
PROPERTY BUILDERS FOR YOUR WINDOWS OR 
WEB CONTROLS 

MIGUEL CASTRO 


AGN401: DEMYSTIFYING URL REWRITING AND 
HTTP MODULES AND HANDLERS 
MIGUEL CASTRO 


AGN202: ASP.NET SEARCH ENGINE 
OPTIMIZATION TIPS AND TRICKS 
ROBERT HOWARD 


AGN303: ASP.NET INTERNALS 
ROBERT HOWARD 


AGN104: CSS 101- BUILDING SITES 
WITHOUT TABLES 
DAVE SUSSMAN 


AMV201: INTRO TO THE ASP.NET 
MVC FRAMEWORK 
MARKUS EGGER 


AMV202: UNDERSTANDING GOALS AND 
FEATURES OF THE ASP.NET MVC FRAMEWORK 
DINO ESPOSITO 


APF301: FROM ONE SERVER TO TWO: 
MAKING THE LEAP 
RICHARD CAMPBELL 


APF302: ASP.NET PERFORMANCE AND SCALE 
TIPS AND TRICKS 
ROBERT HOWARD 


APF203: DEALING WITH LONG RUNNING 
REQUESTS IN ASP.NET 
RICK STRAHL 


ARP201: PROGRAMMING SQL SERVER 
REPORTING SERVICES 
PAUL LITWIN 


ASC401: AJAX AND WEB 
APPLICATION SECURITY 
CHRISTIAN WENZ 


ASL201: SILVERLIGHT WEB CONTROLS... 
YES YOU HEARD RIGHT 
MIGUEL CASTRO 


ASL302: SILVERLIGHT DEVELOPMENT 
FOR MOBILE DEVICES 
NICKOLAS LANDRY 


ASL203: SILVERLIGHT 2.0 ANNOTATION USING 
THE INKPRESENTER CONTROL 
JULIE LERMAN 


ASL204: DATA ACCESS WITH SILVERLIGHT 2 
JOHN PAPA 


ASL305: LEVERAGE SILVERLIGHT 2 
ANIMATION FEATURES 
DAN WAHLIN 
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ШТА NET 


(CONNECTIONS 


HOW TO REVIEW YOUR CODE AND TEST FOR 
SECURITY BUGS 
MICROSOFT 


INTRODUCTION TO MICROSOFT 


SYNC FRAMEWORK 
MICROSOFT 


LINQ TO XML, SQL, ENTITIES, 
DATASETS, AND CO: DATA ACCESS 
TECHNOLOGIES EXPLAINED 
MICROSOFT 


VISUAL STUDIO & .NET * MICROSOFT DAY a 


MICROSOFT VISUAL STUDIO DEVELOPMENT FOR 


MICROSOFT SQL SERVER 2008 
MICROSOFT 


TIPS, TRICKS, AND TECHNIQUES FOR 
BUILDING A GREAT MICROSOFT 
SILVERLIGHT APPLICATION 
MICROSOFT 


ENTITY FRAMEWORK IN A WORLD OF 
SERVICES AND PROCESSES 
MICROSOFT 


WHAT IS THE CONTEXT OF THIS CONVERSATION? 
ENABLING LONG RUNNING CONVERSATIONS IN 
WORKFLOW SERVICES 

MICROSOFT 


DEEP DIVE: ADO.NET DATA SERVICES 
FRAMEWORK - APPLICATION PATTERNS 
MICROSOFT 


ENTITY FRAMEWORK FUTURES 
MICROSOFT 


VISUAL STUDIO & .NET SESSIONS i 


VSM301: ADVANCED TECHNIQUES FOR 
DEPLOYING SMART CLIENT APPLICATIONS 
CATHI GERO 


VCL301: SELECTING THE RIGHT 
CLIENT TECHNOLOGY 
BRIAN NOYES 


VDA309: ANYWHERE ACCESS TO DATA 
MARKUS EGGER 


VDA303: DEEP DIVE INTO ENTITY 
FRAMEWORK OBJECT SERVICES 
JULIE LERMAN 


VVDA307: HOW SYNCHRONIZATION SERVICES 
FOR ADO.NET WORKS 
CATHI GERO 


VDA308: INSIDE BINDING AND MAPPING IN 
LINQ TO SQL 
DINO ESPOSITO 


VDA304: INTEGRATING ENTERPRISE 
LIBRARY'S DATA ACCESS APPLICATION 
BLOCK WITH YOUR PROJECT 

JOHN PAPA 


VDA306: LEVERAGING THE SQL SERVER 
COMPACT EDITION IN AN OCCASIONALLY 
CONNECTED SYSTEM 

WILLIAM R. VAUGHN 


VDA302: MAKING ADO.NET DATA ACCESS 
BREATHTAKINGLY FAST 
DON KIELY 


VDA301: NEW .NET FEATURES FOR 
THE ORACLE DATABASE 
CHRISTIAN SHAY 


VDA305: PRACTICAL STRATEGIES WITH 
THE ENTITY FRAMEWORK 
JOHN PAPA 


VCA300: BUILD A SECURITY SYSTEM FOR 
WINDOWS FORMS USING CLIENT 
APPLICATION SERVICES 

PAUL SHERIFF 


VFR301: .NET WINDOWS FORMS TIPS 
AND TRICKS 
CATHI GERO 


VPA303: PLINQ: LINQ, BUT FASTER! 
STEPHEN TOUB 


VLV200: .NET ROCKS LIVE! 
CARL FRANKLIN & 
RICHARD CAMPBELL 


VPN300: HOW TO RUN 

A CONSULTING BUSINESS 

RICHARD CAMPBELL, ROB HOWARD, 
JUVAL LOWY, PAUL SHERIFF 


VPC301: CODE GENERATION IN 2008 
KATHLEEN DOLLARD 


VPC302: NEW LANGUAGE FEATURES 
IN .NET 3.5 
KATHLEEN DOLLARD 


VPL301: GETTING YOUR TECHNICAL 
WORK PUBLISHED 
WILLIAM R. VAUGHN 


VPA302: PARALLELIZING WCF SERVICES WITH 
VISUAL STUDIO 2008 AND WINDOWS HPC 
SERVER 2008 

NICKOLAS LANDRY 


VTS300: BUILD TEST CASES THE EASY WAY 
WITH VISUAL STUDIO 2008 
PAUL SHERIFF 


VPA301: CONCURRENCY WITH THE TASK 
PARALLEL LIBRARY 
STEPHEN TOUB 


VUI301: THE SCIENCE OF GREAT UI 
MARK MILLER 


VWC303: BUILDING A WCF ROUTER 
FOR YOUR APPLICATIONS 
MICHELE LEROUX BUSTAMANTE 


VWC302: DURABLE WCF SERVICES 
JUVAL LOWY 


VWC304: LOAD BALANCING AND SCALING 
YOUR WCF SERVICES 
MICHELE LEROUX BUSTAMANTE 


VWC301: PRODUCTIVE WCF 
JUVAL LOWY 


VWC305: PRACTICAL SCENARIOS 
FOR FEDERATED SECURITY 
MICHELE LEROUX BUSTAMANTE 


VCF301: ROGUE AND ROUGH: HERE'S 
THE WORLD OF WEB FOR WCF SERVICES 
DINO ESPOSITO 


VWP301: BUILDING DATA VISUALIZATION 
APPLICATIONS WITH THE WINDOWS 
PRESENTATION FOUNDATION (WPF) 
TIM HUCKABY 


VWP303: DESIGNING POLISHED WPF 
INTERFACES WITH EXPRESSION BLEND 
MARKUS EGGER 


VWF301: DEVELOPING SERVICE-ORIENTED 
WORKFLOWS 
BRIAN NOYES 


VWP302: INTEGRATING WPF AND WCF INTO 
YOUR OFFICE BUSINESS APPLICATIONS 
TIM HUCKABY 


VWP304: LEVERAGE AND EXTEND WPF 
ROUTED COMMANDS AND EVENTS 
BRIAN NOYES 


VWP306: .NET 3.5 SP1 FOR WPF DEVELOPERS 
SCOTT STANFIELD 


VWP305: USER CONTROLS AND CUSTOM 
CONTROLS IN WPF 
DINO ESPOSITO 
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DOTNETNUKE 
OPENFORCE 08 


(CONNECTIONS 


OPENFORCE SESSIONS 


Connections introduces you to a co-located 
event in Las Vegas, NV at Mandalay Bay 
Resort & Casino, November 10-13, 2008 


DotNetNuke OpenForce ‘08 is a conference for DotNetNuke developers, 


administrators, and designers. This is a great event for DotNetNuke users 


to connect to some of the great things happening in the .NET Open Source 


community, all in a shared space in Las Vegas, November 10-13, at the 


Mandalay Bay Resort and Casino. DotNetNuke OpenForce ‘08 attendees can 


also attend other concurrently running Connections conferences sessions. 


DGN101: The DNN Approach to Community 
and Commerce 
NAVIN NAGIAH 


DGN102: Panel Discussion: 
DotNetNuke-The Road Ahead 

JOE BRINKMAN, NIK KALYANI, 
NAVIN NAGIAH, SCOTT WILLHITE, 
AND SHAUN WALKER 


SKIN DESIGN 


DSD101: Preparing a Skin Design and Creating 
an HTML-Based Skin Package 
TRACY WITTENKELLER 


DSD201: DotNetNuke and Web Standards 
CUONG DANG 


DSD301: Advanced Skinning with DotNetNuke 5.0 
THOMAS KRAAK 
VASILIS TERZOPOULOS 


MODULE DEVELOPMENT 


SITE ADMINISTRATION 


DMD101: Silverlight Development 
with DotNetNuke 
MICHAEL WASHINGTON 


DMD201: Developing Extensions for 
DotNetNuke 5 
CHARLES NURSE 


DMD202: Data Access in DNN DALs-Boldly 
Going where Some Modules Have Gone Before 
JIM BONNIE 


DMD301: Unit Testing with DotNetNuke 
JIM BONNIE 


DMD302: Leverage DotNetNuke 
with SharePoint 
STEFAN KAMPHUIS 


DMD303: Extending DotNetNuke Modules 
with AJAX 
KEVIN SCHREINER 


DMD304: Using Web 2.0 APIs 
in DotNetNuke Modules 
CATHAL CONNOLLY 


DOTNETNUKE OPENFORCE '08 
KEYNOTE ADDRESS 


SHAUN WALKER 
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DSA101: Selling DotNetNuke-Why Your Clients 
Should Be Using It 
CHRIS HAMMOND 


DSA102: Introduction to Search Engine 
Optimization with DotNetNuke 
THOMAS KRAAK 

DSA103: An Introduction to DotNetNuke 
5.0 Administration 

CHRIS HAMMOND 


DSA201: Building Secure 
DotNetNuke Installation 
CATHAL CONNOLLY 


DGN103: DotNetNuke: Real World, Real 
Problems, Real Solutions 
NIK KALYANI 


DMD305: Extending DotNetNuke with 
FaceBook and OpenSocial 
NIK KALYANI 


Please Visit: 
www.DevConnections.com/OpenForce 
for details and a full list of topics, 
abstracts, speakers and bios! 


OCTOBER 6-8, 2008 
SAN FRANCISCO MARRIOTT 
SAN FRANCISCO, CA 


BRING YOUR TEAM 
TO IT CONNECTIONS 
IN SAN FRANCISCO 


Strategic and technical expertise 
to guide your technology decisions 
and implementations 


Imagine the opportunity for your IT 
leadership-executives and management- 
to develop strategic visions for your 
enterprise technology with the guidance of 
industry leaders...and for IT professionals to 
master the details of implementing those 
technologies through in-depth workshops led 
by renowned experts then to come together, 
as a team, joined by IT professionals and 
leadership from other business, academic, 
and governmental organizations... To learn... 
to discuss... to question... to solve... and 

to share. 


тун > OCT 08 | 
IT Connections 


"th iar RN Early Bird 


M. Registration Bonus: 
receive a FREE NIGHT 


at the San Francisco 
Marriott if you register 
by August 11" 2008 
(based on a 3-night 
minimum stay) 


This unique 3-day conference will feature 
strategic sessions to help your enterprise align 
important new technologies to support your 
near and long term requirements, including: 


m Virtualization 

m Cloud Computing 

m Automation and Consolidation 
ш Green Computing 

m Unified Communications 

m Systems Management 

m Security 


And incredible technical workshops led 
by independent, nationally-recognized gurus 
featuring: 


m Windows Server 2008 and Windows Vista 

m Active Directory, Group Policy, and PowerShell 
m Exchange and Office Communications Server 
m SharePoint 

m System Center 

m Hyper-V and VMware 

m SQL Server 2008 


DEVELOPED BY TECHNET, MICROSOFT, PENTON MEDIA, AND HP 


THIS EVENT IS FOR: 
CIOS / CTOS е TECHNICAL DECISION MAKERS е BUSINESS DECISION MAKERS е IT MANAGERS • AND IT PROFESSIONALS 


Bring Your IT Team! 
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p PRE-CONFERENCE WORKSHOPS 


NOVEMBER 9, 2008 


SQL SERVER 


PRE-CONFERENCE WORKSHOP > 9AM-4PM 


DATABASE BEST PRACTICES FOR THE INVOLUNTARY DBA 
KIMBERLY L. TRIPP & PAUL S. RANDAL 


Have you been nominated as "the SQL person” on your team? Are you a 
developer who's suddenly found their test database has become critical for 
your company's business? Have you become a DBA-even only accidentally- 
and do you find yourself managing SQL Server database(s) more and more? 
Are you sure your data is protected? Are you sure your applications can 
scale? The one thing you NEED now, to manage this system correctly-is 
knowledge! We'll cover all of the critical components related to configuring, 
implementing, and maintaining a SQL Server system. Topics will include an 
overview of SQL Server components, protecting and maintaining the data, 
writing effective server-side components (e.g., procedures and transactions), 
and many other items that all require server-side smarts. Come to this work- 
shop to find out the things you need to know to successfully manage SQL 
Server from the beginning-a day spent here will save you many more! 


NOVEMBER 10, 2008 


SQL SERVER 


PRE-CONFERENCE WORKSHOP > 9AM-4PM 

RELATIONAL DATA WAREHOUSING: LEVERAGING KEY FEATURES 
OF SQL SERVER 2005/2008 

KIMBERLY L. TRIPP & PAUL S. RANDAL 


Relational data warehouses are critical to every business, but building one 


using SQL Server has traditionally been difficult due to the lack of enabling fea- 


tures. SQL Server 2005 began addressing this with the addition of partitioned 
tables/indexes and online, piecemeal operations such as index maintenance, 
backups, and restores. SQL Server 2008 adds many significant new features to 


aid in relational data warehousing, such as data compression, change data cap- 


ture, and filtered indexes, plus some excellent additions and refinements to 
partitioning. In this information-packed session, we will examine how you can 
make the most of the key Database Engine features in SQL Server 2005 and 
2008 to implement and manage a mission-critical relational data warehouse. 
Attendees will also receive a copy of our very popular SQL Server 2008 VPC 
with over 24 hours of hands-on labs targeting many of these features. 


PRE-CONFERENCE WORKSHOP > 9AM-4PM 


QUERY TUNING IN MICROSOFT SQL SERVER 2005 AND 2008 
ITZIK BEN-GAN 


This workshop teaches you how to optimize problematic queries by tuning 
indexes and writing efficient code. The workshop covers in detail internal 
structures and index access methods, which are the fundamental building 
blocks that you need to be familiar with in order to master the art of query 
tuning and optimization. Once you get familiarized with those fundamental 
building blocks, you will learn how to put your knowledge into action by 
benchmarking various indexing options, analyzing their performance, and 
choosing the most ideal design. The workshop will also teach you how to tune 
and optimize your solutions by applying query revisions that can yield 
improvements in orders of magnitude in many cases. The workshop will also 
teach you how to get rid of cursors when set-based solutions are most appro- 


priate, and how to identify the uncommon cases where cursors are the last 
resort that will yield better performance than set-based solutions. 


If time permits, the seminar will also discuss compilations, recompilations, 
and reuse of execution plans. 


The seminar will cover new features in SQL Server 2008 where relevant. 


ASP.NET 


PRE-CONFERENCE WORKSHOP > 9AM-4PM 


SILVERLIGHT 2 DEVELOPMENT WORKSHOP 
DAN WAHLIN 


Silverlight 2 provides a powerful framework for building Rich Internet 
Applications (RIAs) that capture the attention of end users. In this workshop, 
Dan Wahlin will discuss Silverlight 2 technologies including language features, 
built-in controls, control templates, styles, networking features, animations, 
data binding, and more. Learn to build engaging applications using the latest 
client-side technology. 


VISUAL STUDIO 


PRE-CONFERENCE WORKSHOP > 9AM-4PM 
INTRODUCING WINDOWS WORKFLOW 
KATHLEEN DOLLARD 


You've heard about Windows Workflow Foundation, but no one has shown you 
how to implement it for your applications. This workshop starts with an 
overview of Windows Workflow and why it's likely to become a key part of 
your development strategy. You'll watch the creation of a complex sequential 
workflow integrating human and computer-based actions. Then you'll see a 
similar problem solved using a state machine workflow. Each workflow 
includes standard Windows Workflow tasks, custom tasks, and rule-based 
decisions. You'll see interactions with things outside the workflow-including 
notifying people and other systems, handling events, and implementing data 
exchange services. The workflow becomes more sophisticated as it integrates 
with the Visual Studio 2008 features that integrate with WCF. Workflows don't 
just handle process-they also manage the grimy details of robust systems- 
transactions and compensation, tracing, status reporting, and exception man- 
agement. You'll see how to implement these details and understand the role 
of the host in providing necessary services. Before closing we'll circle back 
around to designing workflows. Workflow design presents new challenges to 
developers, particularly since you can share this design experience with 
power end users-actually letting them design portions of the workflow. In 
this workshop, you'll learn how to recognize good workflow candidates, make 
decisions on workflow granularity, determine how to share design responsi- 
bilities, and implement workflow details. 


PRE-CONFERENCE WORKSHOP > 9AM-4PM 


ADO.NET ENTITY FRAMEWORK: 0-60 
JULIE LERMAN 


This full day workshop will provide you with a more complete overview on 
ADO.NET Entity Framework, Microsoft's new core data platform, than you could 
possibly get in an handful of introductory sessions. In this workshop, you will 
learn what the Entity Framework is and how it fits into your application and 
enterprise architecture. We will begin with an introduction to the Entity Data 
model, how to build it, and how to implement it in its simplest form. Then you 
will learn how to take advantage of the true power of the Entity Data Model by 
creating customized mappings. You will learn how to query Entity Data Models 
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WORKSHOPS AND SPEAKERS 
ARE SUBJECT TO CHANGE. SEE 
WEB SITE FOR THE MOST CURRENT 


DESCRIPTION AND AVAILABILITY. 


using LINQ to Entities and Entity SQL with Object Services and stream data with Entity Client. The 

session will also explore some of the more complex features of object services as well as offer SC H EDU LE 

guidance as to when and where you will want to use the Entity Data Model and which of its core at a glance 

querying methods is right for different scenarios. Throughout the workshop we'll look at some 

practical applications of Entity Framework. SUNDAY, NOVEMBER 9, 2008 
T30am - 12:00pm - istrati 

SHAREPOINT pm Pre-Conference Registration ONLY 

9:00am - 400pm Рге-сопѓегепсе Workshops 

PRE-CONFERENCE WORKSHOP > 9AM-4PM MONDAY, NOVEMBER 10, 2008 

SHAREPOINT SERVER 2007 DOCUMENT MANAGEMENT BEST PRACTICES 7:00 ат - 5:00pm Conference Registration 

BEN CURRY 9:00 am - 4:00pm Рге-сотегепсе Workshops 

Document management is the process of applying creation, management, storage and other 6:30pm - 8:30pm Opening Keynote 


rules to how documents are created, persisted and expired within an organization. Document 
collaboration is merely the process of checking out, checking in, and versioning a document 


TUESDAY, NOVEMBER 11, 2008 е MICROSOFT DAY 


before it is published. Windows SharePoint Services gives you document collaboration where as 7:00am - 5:00pm — Conference Registration 
SharePoint Server 2007 gives you document management. Records management encompasses 7:00am - 8:00am Continental Breakfast 
all of that which is document management plus it applies to a broader set of content elements- А қ 

| | lies 8:00am 9:00am — Keynote 
not just documents. Any electronic record, such as a list item or log entry, can be managed as | . . 
well in SharePoint Server 2007 if there is a need to do so. Managing these documents involves 930am - 10:30am Conference Sessions 
workflows, templates, expiration policies, and integration with the Microsoft Office suite. This 10:45 am - 11:45am Conference Sessions 
workshop will cover the following: 1:45 ат - 1:30pm — Lunch 


1. Creating and managing Web applications for document collaboration 


a. Content database planning and management 130 т - 230pm — Conference Sessions 


b. Information architecture 2:45pm - 345pm Conference Sessions 

& ае DIES те " | 5:00pm - 7:00pm Ехро Най Opens/Opening Reception 
E d T. ШИЕ ш NS from an аи 5 подари 7 WEDNESDAY, NOVEMBER 12, 2008 
. Creating and managing large lists for performance using indexed columns and folders eem 

шаш) leng pener g 7:00am - 5:00pm — Conference Registration 

4. Integration with third-party products and Microsoft Outlook 2007 T00am - 8:00 . 
5. An overview of using Workflows for business processes did ‘00am — Continental Breakfast 
6. Leveraging content types for document management 8:00am - 9:15am — Conference Sessions 

a. Templates 10:00am - 11:15 ат ^ Conference Sessions 

b. Expiration ; - 12. ; 

c. Metadata collection via site columns and document information panels 130ап - 1248 pm Conference Sessions 

d. Workflows 12:45 рт - 2:15pm Lunch 
7. Replacing file shares with SharePoint (or why not to) 2:15pm - 3:30pm Conference Sessions 
8. Configuring document repositories for search and findability 415 рт - 5:30pm Conference Sessions 
9. Managing documents from multiple locations THURSDAY, NOVEMBER 13, 2008 
10. Creating and managing a records repository 7:00am - 8:00am Continental Breakfast 
Tl. Understanding and using the Recycle Bin for item recovery 8:00am - 9:15am ^ Conference Sessions 


PRE-CONFERENCE WORKSHOP > 9AM-4PM 9:30am - 10:45am Conference Sessions 


PLATFORM EXTENSION MODEL FOR SHAREPOINT PRODUCTS 1:30 ат - 12:30pm — Conference Sessions 
AND TECHNOLOGIES 12:30pm - 2:15pm Lunch 
Шы ЕШ 2:15 pm Expo Hall Closes 
The goal of the Platform Extension Model for SharePoint Products and Technologies is to help 215pm - 3:15pm Conference Sessions 


architects and project planners understand how best to map their solution requirements with 
the ITB (In The Box) features of the SharePoint platform to minimize the amount of custom 
coding and maximize the amount of solution development through configuration (solution FRIDAY, NOVEMBER 14, 2008 
composability). The SharePoint Feature Dependency Network is also introduced. 9:00am - 4:00pm — Post-conference Workshops 


3:45pm - 4:30pm — Closing Session 


TUESDAY, NOVEMBER 11: 
“WOMEN IN TECHNOLOGY” 


LUNCHEON 
SEE WEB SITE FOR DETAILS. 


NOTE: LUNCH IS INCLUDED WITH FULL DAY WORKSHOPS + THE COST OF A WORKSHOP IS IN ADDITION TO THE REGULAR CONFERENCE FEE 
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i POST-CONFERENCE WORKSHOPS 


NOVEMBER 14, 2008 


SQL SERVER 


ASP.NET 


POST-CONFERENCE WORKSHOP > 9AM-4PM 
DATADUDE TO THE MAX (BRING YOUR OWN LAPTOP) 
GERT DRAPERS 


The latest release of Visual Studio Team System Database Edition, not only 
enables support for SQL Server 2008 and all its new metadata, it includes a 
completely revamped build and deployment engine and new tools for increas- 
ing the quality of your database schemas. This workshop will guide you 
through all the steps from how to get set up, creating your initial enlistments, 
building deployment packages, how to create configuration files for your 
deployment packages, and how to test and validate your deployments. If you 
bring your own notebook you can follow along using the VPC provided. You 
can attend without a laptop but your experience will be significantly better 
with one! This is meant as an advanced workshop and will expect a reason- 
able laptop configuration in order to participate: 

= Virtual PC 2007-already installed 

m At least 1 GB of physical memory м/512 MB dedicated to the VPC environ- 

ment (2 GB is preferred w/1 GB dedicated to VPC) 
m 12 СВ of physical disk space (20+ GB is preferred) 
= DVD drive 


SHAREPOINT 


POST-CONFERENCE WORKSHOP > 9AM-4PM 


THE SHAREPOINT DEVELOPER, DESIGNER, AND POWER USER 
GAME SHOW 


DUSTIN MILLER 


During the SharePoint Developer, Designer, and Power User Game Show, you'll 
learn the right way and the wrong way to develop custom solutions, design 
master pages and themes, and customize your site with tools like SharePoint 
Designer. This post-conference workshop is designed to appeal to developers, 
Web designers, and even "power users" who want to know how best to take 
advantage of SharePoint as a platform for collaboration and development. 
While there will be some focused discussions involving topics like .NET cod- 
ing, master page and page layout design, and data view Web parts, the work- 
shop will include sample code and ideas for every attendee, and is designed 
to allow everyone to take away something useful and powerful for their own 
SharePoint projects, no matter what their role. While there won't be lab 
assignments during this session, written labs will be provided to each 
attendee via an online site exclusive to this post-conference workshop. Plus: 
It's a game show! Plan to have fun and maybe even win some prizes! 


POST-CONFERENCE WORKSHOP > 9AM-4PM 

PATTERNS OF ASP.NET AJAX APPLICATION ARCHITECTURE 

DINO ESPOSITO 

ASP.NET AJAX applications do not have much in common with classic ASP.NET 
applications based on the Web Forms model. Architecturally speaking, AJAX 
applications are based on a two-tier presentation model where the front-end 
runs entirely on the client and is written in JavaScript and the back-end is an 
ad-hoc service layer that exposes public HTTP endpoints. Any data exchange 
between the tiers is based on JSON packets. ASP.NET AJAX provides an excel- 
lent model for designing and building a service-based back-end using either 
ASMX Web services or WCF services. But it is not of much help as far as the 
presentation is concerned. Once the client has collected raw data as the result 
of a server operation, how can you craft some good user interfaces? The first 
problem to face is just the implementation of an HTML factory. This can be a 
piece of software that runs entirely browser side and is coded using 
JavaScript. At the very minimum, it requires helpers for data-binding and tem- 
plates. Alternatively, you can force some of your AJAX services to operate as 
HTML factories and return HTML snippets in front of raw data. Performance 
and design considerations apply to both solutions, as you can easily imagine. 
A full Web-based rich user interface, though, also requires care when it comes 
to time out or throttle calls that may put too much pressure on the server. Not 
to mention that users of an AJAX application are active all the time and can 
start unneeded and unwanted operations if HTML input elements are not prop- 
erly disabled. In the end, architecting a true AJAX solution is not a walk in the 
park. But thankfully a number of recognized patterns exist to provide guidance 
on the toughest decisions. 


VISUAL STUDIO 


POST-CONFERENCE WORKSHOP > 9AM-4PM 
IMPLEMENTING BEST PRACTICE DATA ARCHITECTURES 
WILLIAM R. VAUGHN 


Many companies are at the stage of morphing or merging small applications into 
large systems but fail to implement efficient, scalable, supportable designs. 
Other shops are transitioning from Access/JET, Visual Basic 6.0, or other older 
technologies to the .NET Framework but have been unable to get a foothold on 
the best practices and available architectural choices. This often means cus- 
tomers are unhappy with performance, data security, and responsiveness of the 
development team to requested changes. After code review we typically find 
problems that center on data architecture and implementation issues where 


CONFERENCE REGISTRATION INCLUDES: 


Microsoft ASP.NET and 
Visual Studio Connections attendees 
will receive a one-year subscription to msdn 


A full membership to SSWUG.ORG, the 
SQL Server Worldwide User's Group Help 
Center site. The site includes 100s of scripts, discussion 
boards, artietes-reviews-e-mail discussions, and more. 


Your Database Ans 


Three Lunches 

Three Continental Breakfasts 
Reception 

Conference T-Shirt and Bag 
Software 

Proceedings Resource CD 
.. and more 
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fairly fundamental concepts have been overlooked or misunderstood. We find 
developers that are unsure about how their DBMS engine works, that they've 
chosen the wrong engine or have pushed it well beyond its limits. We find teams 
and data architectures that fight over shared resources and confusing design 
choices as Microsoft constantly adds new solutions. 


This workshop is designed to help developers gain a solid footing on the 
foundations of data access architecture. We discuss several alternative 
approaches and where each is best suited. We discuss how SQL Server works 
and how to choose the "right" version for their design today and tomorrow. 
We discuss the Visual Studio and SQL Server tools including SQL Server 
Profiler, SQL Server Management Studio, and the Visual Studio code genera- 
tors that can make the job seem easier but might also be the source of per- 
formance or code maintenance issues. This workshop includes Bill's popular 
sessions on "Getting Connected" and "Managing CLR Executables" as well as 
sessions on the new RDL reporting technology. This content is updated to 
reflect Visual Studio SP1 Business Intelligence tools in anticipation of SQL 
Server 2008's RTM. 


This workshop is all about data. It's about data architectures, data validation, 
connecting to data engines, running efficient queries, managing the resultsets, 
building server-side executables, cursors, constraints, indexes and managing 
users, and rights and security. It's about choosing how and where to save, 


retrieve, and protect data. It's about how to build efficient forms-over data appli- 


cations whether they are Windows Forms, WPF, WCF, ASP.NET or whatever new 
paradigm Microsoft thinks up between now and when the conference starts-or 
years in the future. 


WORKSHOPS AND SPEAKERS ARE SUBJECT TO CHANGE. 
SEE WEB SITE FOR THE MOST CURRENT 
DESCRIPTION AND AVAILABILITY. 


POST-CONFERENCE WORKSHOP > 9AM-4PM 
SERVICE-ORIENTATION, WCF, AND YOU 
JUVAL LOWY 


Contrary to common wisdom, service-orientation is not just for high-end appli- 
cations. Every application should be service-oriented, and Windows 
Communication Framework (WCF) is the .NET runtime for developing, deploying, 
and consuming service-oriented applications. But what is service-orientation 
really about? What does it mean for mere developers? Is there substance 
behind the hype? In this comprehensive one-day workshop, Juval will first 
demystify service-orientation for you, and introduce the basic motivation for 
service-oriented applications and their operating principal and concepts. In 
that light, Juval will then describe what WCF is and how it is designed, and 
demonstrate its advantages over traditional .NET programming. You will see 
that WCF is more than just the next generation platform for building connected 
Systems. In many respects, WCF is the next development platform for Windows 
applications, providing system features that are presently crafted by hand on 
top of .NET and Windows. With WCF, every class automatically benefits from 
these system features, from security to transactions to tracing and logging and 
much more. To maximize the use of these off-the-shelf plumbing aspects you 
should push the service boundary down into your system, but taken to its ulti- 
mate conclusion-should every class be a WCF services? And what about per- 
formance? The workshop will next demonstrate the power and productivity of 
WCF, contrasting WCF used granularly on every class with classic .NET in terms 
of performance, throughput and scalability, and will substantiate the provoca- 
tive claim that every class can and should be a service. Don't miss on this 
unique opportunity to understand SOA and WCF from Juval Lowy who has been 
part of the strategic design effort for WCF from the beginning, and who offers a 
profound insight on the methodology, the technology, and its application. 
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Work around SOL Servers 
incomplete support 


emporal data can be difficult to handle in 

SQL Server queries, because SQL Server 

implements only a subset of the features 
that are defined by ANSI SQL to support temporal 
data. Even in SQL Server 2008, temporal data types 
represent only a moment in time—no support exists 
for an INTERVAL data type that represent a time 
quantity. In addition, no native support is available for 
operations on temporal data, such as checking whether 
two time periods overlap, or merging intersecting time 
periods. You must create your own custom solutions 
for such operations. For example, you can represent a 
period of time either as two points in time (start time 
and end time) or as a start point in time and an integer 
representing the duration in a predetermined unit (e.g., 
a second). 


The Challenge 

A friend and colleague, Davide Mauri, recently pre- 
sented me with a temporal querying problem. The chal- 
lenge involves changes that take place in attribute values 
of entities (e.g., customers). Suppose that you keep track 
of the validity periods of customers’ attribute values, 
such as phone numbers and addresses. You have a table 
called Phones where you keep track of the validity 
periods for phone numbers, a table called Addresses with 
validity periods of addresses, and so on. The challenge 
is to produce all periods with distinct combination of 
attribute values (phone number, address, etc.). 

Run the code in Listing 1 to create the Phones and 
Addresses tables and populate them with sample data. 
Notice that I didn't include an attribute in the tables to 
hold a customer ID; I wanted to simplify the problem 
and focus on the temporal querying logic. 

For each phone number and address, the pair 
of attributes startdt and enddt represent the value's 
validity period. The attribute value's validity period 
is greater than or equal to startdt and less than enddt 
(startdt < period « enddt). A NULL in the enddt value 
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stands for no end date or still applicable. As | men- 
tioned earlier, the challenge is to produce all periods of 
time with distinct phone and address values. Table 1, 
page 22, shows the desired output. Before you read 
Davide's solution and my solution, try to solve the 
problem on your own. 


Solution 1 

Davide's complete solution appears in Listing 2, page 
22. As you can see, the solution is expressed as a single 
statement that defines multiple common table expres- 
sions (CTEs). For simplicity, ГЇ explain Davide's 
solution one CTE at a time. Note that the code uses 
language elements that were introduced in SQL Server 


LISTING 1: Script that Creates and 


Populates Phones and Addresses Tables 


SET NOCOUNT ON; 
USE tempdb; 
GO 


FEATURE 


Itzik Ben-Gan 
itzik @ solidqualitylearning.com , а mentor at 


Solid Quality Learning, teaches, lectures, and 
consults internationally. He manages the Israeli 
SQL Server Users Group, is a SQL Server MVP, 
and is the author of the Inside Microsoft SQL 
Server 2005: T-SQL series (Microsoft Press, 2006). 


IF OBJECT ID('dbo.Phones') IS NOT NULL DROP TABLE dbo.Phones; 
IF OBJECT ID('dbo.Addresses') IS NOT NULL DROP TABLE dbo. 


Addresses; 
GO 


CREATE TABLE dbo.Phones 
(t 
phone VARCHAR(1@@) NOT NULL, 
startdt INT NOT NULL, 
enddt INT NULL, 
PRIMARY KEY(phone, startdt), 
UNIQUE(phone, enddt), 
CHECK(enddt » startdt) 


); 


CREATE TABLE dbo.Addresses( 
address МАКСНАК (100) NOT NULL, 
startdt INT NOT NULL, 
enddt INT NULL, 
PRIMARY KEY(address, startdt), 
UNIQUE(address, enddt), 
CHECK(enddt » startdt) 

); 


INSERT dbo.Phones (phone, startdt, enddt) 
VALUES(‘Phone 1’, 20071219, 20080202); 

INSERT dbo.Phones (phone, startdt, enddt) 
VALUES(‘Phone 2’, 20080202, NULL); 


INSERT dbo.Addresses (address, startdt, enddt) 
VALUES(‘Address 1’, 20071201, 20071231) 

INSERT dbo.Addresses (address, startdt, enddt) 
VALUES(‘Address 2”, 20071231, NULL); 
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TEMPORAL DATA 


TABLE 1: Desired Results 


startdt enddt phone address 

20071201 20071219 NULL Address 1 
20071219 20071231 Phone 1 Address 1 
20071231 20080202 Phone 1 Address 2 
20080202 99991231 Phone 2 Address 2 


LISTING 2: Solution І 


WITH TimeStamps AS 
(6 


SELECT startdt AS ts FROM або. Рһопеѕ 


UNION ALL 


SELECT COALESCE(enddt, 99991231) FROM dbo.Phones 


UNION ALL 


SELECT startdt FROM dbo.Addresses 


UNION ALL 


SELECT COALESCE(enddt, 99991231) FROM dbo.Addresses 


), 
TSDR AS -- Timestamps with Dense Ranks 


SELECT DISTINCT ts, DENSE RANK() OVER(ORDER BY ts) AS pos 
FROM TimeStamps 


2. 
Intervals AS 


SELECT Cur.ts AS startdt, Nxt.ts AS enddt 
FROM TSDR AS Cur 
JOIN TSDR AS Nxt 

ON Nxt.pos = Cur.pos + 1 


2, 
UnifiedValues AS 
( 


SELECT “рһопе” AS attr, phone AS val, startdt, 
COALESCE(enddt, '99991231') AS enddt 


), 


UNION ALL 


FROM dbo.Phones 


SELECT ‘address’, address, startdt, COALESCE(enddt, ‘99991231’) 
FROM dbo.Addresses 


ValidValues AS 
( 


SELECT I.startdt, I.enddt, V.attr, V.val 
FROM Intervals AS I 


JOIN UnifiedValues AS V 


) 


SELECT 


ON V.enddt > I.startdt AND V.startdt < I.enddt 


FROM ValidValues 
PIVOT(MAX(val) FOR attr IN(phone, address)) AS P; 


TABLE 2: 
Solution 1, 


Output of Query 


Defining Time- 
stamps CTE 


20071219 
20080202 
20080202 
99991231 
20071201 
20071231 
20071231 
99991231 
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2005 (CTEs and the PIVOT operator); therefore you 
can’t run the code if you're using a previous version of 
SQL Server. However, you can easily adapt the solution 
to earlier versions of SQL Server by converting the use 
of CTEs to derived tables, and use pivoting techniques 
that were supported in SQL Server 2000. 

The code in Davide's solution first defines a CTE 
called Timestamps that represents all timestamps where 
the validity period 
of an attribute value 


TABLE 3: Solution 


1, Output of Query either starts or ends. 
Defining TSDR CTE Тіс code defining 
Е nos the Timestamps 

CTE has four que- 
20071201 1 ries, each returning 
20071219 2 either a start time 
20071231 3 or an end time of 
20080202 4 an attribute value, 
99991231 5 and all result sets 


are unified with 


UNION ALL set operations. Table 2 shows the output 
produced by the query that defines the Timestamps 
CTE. Notice in Table 2 that NULL end times were 
substituted by the value 99991231, and that duplicate 
timestamp values may appear. 

The second step in the solution is to define the CTE 
TSDR (short for timestamps with dense ranks). The 
query defining this CTE calculates dense rank values to 
position the timestamps chronologically, and it uses the 
DISTINCT clause to get rid of duplicate timestamps. 
The output of the query defining the TSDR CTE 
is shown in Table 3. Notice in the output that after 
the removal of duplicate timestamps, only 5 out of 8 
entries remain. 

The third step in the solution is to define the CTE 
Intervals. The query defining this CTE joins two 
instances of TSDR (aliased as Cur and Nxt) to pro- 
duce all possible periods of time from the timestamps 
in TSDR. The JOIN condition used for this purpose 
is Nxt.pos = Cur.pos + 1, meaning that each point in 
time that is considered as the start of a period will be 
matched with the nearest future point as the end of the 
period. The output of the query defining the Intervals 
CTE is shown in Table 4. 

The fourth step in the solution is to define the CTE 
called UnifiedValues. This CTE is independent of the 
previously defined CTEs; the code defining this CTE 
queries the Phones and Addresses tables directly, and it 
uses a UNION ALL set operation to unify the validity 
periods of phones and addresses. The code returns a 
string with the attribute type (‘phone’ | ‘address’) in the 
attr column, and the attribute value in the val column. 
The code uses the COALESCE function to replace a 
NULL in the enddt attribute to the value 99991231. 
The output of the query defining the Unified Values 
CTE is shown in Table 5. 

The fifth step in the solution is to define the CTE 
ValidValues. The query defining this CTE joins the 
Intervals CTE with the UnifiedValues CTE to match 
possible periods (from Intervals) and validity periods 
(from UnifiedValues) that overlap. The join predicate 
ensures that the two periods overlap. Two periods (e.g., 
pl and p2) overlap if pl.end > p2.start and pl.start 
« p2.end. The query defining the ValidValues CTE 
returns for each pair of overlapping periods the start 
time and end time of the period from intervals, the 
attribute type (‘phone’ | ‘address’), and the attribute 
value. The output of the query defining the Valid- 
Values CTE is shown in Table 6. 

The code defining the CTE ValidValues returns 
the correct result, only with a separate row for each 
distinct period and attribute. The final step in the solu- 
tion is achieved by the outer query. This query pivots 
the attributes such that you get a row for each distinct 
period, a column for each attribute, and the attribute 
value in the intersection of period and attribute. 
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TABLE 4: Solution 


1, Output of Query 
Defining Intervals 
CTE 
startdt enddt 
20071201 20071219 
20071219 20071231 
20071231 20080202 
20080202 99991231 
Solution 2 


Davide and I took similar approaches in the first part 
of our solutions, but we took different approaches 
in the second part. My complete solution appears in 
Listing 3. 

The first step in my solution defining the CTE 
Timestamps is almost identical to Davides Time- 
stamps CTE, except that mine uses a UNION opera- 
tion as the last set operation instead of UNION ALL. 
This means that duplicate timestamps are removed at 
this step in my solution. 

In the second step (in my solution, defining CTE 
TSRN—timestamps with row numbers), I didn’t 
need to use the combination of the DENSE RANK 
function and the DISTINCT clause. Instead, I simply 
assigned row numbers to position the timestamps 
chronologically. 

The third step in my solution (1.е., defining the 
Intervals CTE) is identical to Davide's. Then our solu- 
tions start to differ. My solution reaches the last step at 
this point, implemented by the outer query. The outer 
query joins the Intervals CTE, which contains all dis- 
tinct possible periods with each of the attribute tables 
(Phones and Addresses, in our case) containing validity 
periods, to match all overlapping validity periods to 
each possible period. A LEFT OUTER JOIN is used 
because there's no guarantee that each possible period 
will find a match in each attribute table. 


Maintaining the Solutions 

As you can see from this problem, treatment of time 
periods can be challenging and quite tricky—especially 
because SQL Server has incomplete support for tem- 
poral data. If you want to use Davide's or my solution 
to support new attributes, you'll need to create a new 
table for each attribute, then revise the solution to 
include the attributes. For either solution, you'll need 
to revise the Timestamps CTE, adding the timestamps 
from the new attribute table. For Davide's solution, 
you'll need to revise the UnifiedValues CTE, adding 
a UNION ALL set operation and a query against the 
new attribute table to pull the validity periods of the 
new attribute. In addition, you'll need to add the new 
attribute name to the IN clause of the PIVOT operator 
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TEMPORAL DATA 


TABLE 5: Solution 1, Output of 
Query Defining UnifiedValues CTE 


attr val startdt enddt 

phone Phone 1 20071219 20080202 
phone Phone 2 20080202 99991231 
address Address 1 20071201 20071231 
address  Address2 20071231 99991231 


in the outer query. For my solution, you'll need to 
revise the outer query, adding a LEFT OUTER JOIN 
to the new attribute table. 

Did you manage to come up with a different solu- 
tion than mine or Davide'? If so, go to www.sqlmag 
-com/article/articleid/99874/sql. server. 99874.html and 
share your solution by posting a comment to this 
article. En 

InstantDoc ID 99874 


TABLE 6: Solution I, Output of Query 


Defining ValidValues CTE 


startdt enddt attr val 
20071201 20071219 address Address 1 
20071219 20071231 phone Phone 1 
20071219 20071231 address Address 1 
20071231 20080202 phone Phone 1 
20071231 20080202 address Address 2 
20080202 99991231 phone Phone 2 
20080202 99991231 address Address 2 


LISTING 3: Solution 2 


WITH Timestamps AS 
K 


SELECT startdt AS ts FROM dbo.Phones 


UNION ALL SELECT COALESCE(enddt, 99991231) FROM dbo.Phones 


UNION ALL SELECT startdt FROM dbo.Addresses 


UNION SELECT COALESCE(enddt, 99991231) FROM dbo.Addresses 


2, 
TSRN AS -- Timestamps with Row Numbers 


SELECT ts, ROW NUMBER() OVER(ORDER BY ts) AS pos 
FROM Timestamps 


Intervals AS 


SELECT Cur.ts AS startdt, Nxt.ts AS enddt 
FROM TSRN AS Cur 
JOIN TSRN AS Nxt 
ON Nxt.pos = Cur.pos + 1 
) 
SELECT I.startdt, I.enddt, P.phone, A.address 
FROM Intervals AS I 
LEFT OUTER JOIN dbo.Phones AS P 
ON COALESCE(P.enddt, 99991231) » I.startdt 
AND P.startdt « I.enddt 
LEFT OUTER JOIN dbo.Addresses AS A 
ON COALESCE(A.enddt, 99991231) » I.startdt 
AND A.startdt « I.enddt; 
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automate 


SQL 
SERVER 


Error Log Checking 


A custom solution for a mixed environment 


Server has a built-in GUI you 
can use to expand the SQL 
Server Logs node to check 


error logs. In SQL Server 2000 this GUI is the Enter- 
prise Manager; in SQL Server 2005 it's SQL Server 
Management Studio (SSMS). Because using these 
tools to examine log contents can be slow, many people 
instead log on to the server console to read the physical 
logs with WordPad. In addition, some DBAs use the 
undocumented stored procedure sp readerrorlog to 
view logs. However, these methods are inefficient and 
labor intensive. If you're managing thousands or even 
just hundreds of SQL Server systems, you might spend 
most of the day manually checking each server. An 
alternative is to use a third-party tool to automate the 
process. But even this solution isn't ideal; the tool you 
choose might lack certain flexibility, such as the ability 
to add or remove target events at will or the ability 
to adjust the reporting time frame for error logging. 
Moreover, third-party tools generate additional costs 
and installation time. 

My solution was to create my own automated, cus- 
tomizable, flexible, and accurate method for searching 
and reporting on SQL error logs. I designed my solu- 
tion for an environment in which a large number of 
SQL Server 2005 and SQL Server 2000 instances 
coexist. 


My Environment 

The SQL Server farm that I manage consists of about 
50 SQL Server 2005 systems and 50 SQL Server 2000 
systems. I have a dedicated SQL Server 2005 box that 
serves as a central monitoring server. This system runs 
SQL Server 2005 Enterprise Edition SP2 on top of 
Windows Server 2003 SP2. I established linked servers 
on this system to connect to the remote client server 
via the current login’s security context. Separate jobs 
run on the central monitoring server and the remote 
client servers. You can view these processes as being 
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built on a client/server architecture. The client-side 
job saves meaningful searched errors in a table based 
on certain customizable criteria. The server-side job 
polls information from the clients and sends email 
reports if errors are found. Note that I use the terms 
“clients,” “client servers," and “remote client servers" 
interchangeably to describe the servers being moni- 
tored (like a client). 


Findstr.exe 

The DOS utility findstr.exe is fast and powerful for 
searching ASCII files for strings. When combined with 
files containing a group of strings to be included or 
excluded, findstr.exe is an ideal tool for searching SQL 
error logs in SQL Server 2000. 

The following example demonstrates findstr 
.exe’s capabilities. First, build the folder structure 
on a remote client server by creating a folder named 
SQLErrorReport at the C root. Copy 
into this folder the inclusion file that Web 
Listing 1 (www.sqlmag.com, InstantDoc 
ID 99934) contains and the exclusion file 
that Web Listing 2 contains. Rename these 
files findstr_incl.txt and findstr_excl.txt, respectively. 
Make sure the SQL Server Agent service account has 
read and write permissions to this folder. The remote 
client process calls the stored procedure Usp_SQL 
ErrorLogReportClient. Web Listing 3 contains the 
code for this stored procedure, which enumerates 
and reads error logs within the desired time frame, 
as well as searches for and saves DBA-defined error 
strings. The client process is implemented through a 
scheduled job, which Web Listing 4 contains. Run 
Web Listing 3 and Web Listing 4 to prepare the 
client process. (Later in the article, ГЇЇ explain how 
to quickly create a process in case you have many 
SQL Server systems to monitor and you don’t want 
to create each one manually.) You can change the job 
schedule to suit your needs. 
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ERROR LOG CHECKING 


The stored procedure Usp SQLErrorLogReport 
Client now resides in the master database, with dbo as 
schema. The procedure takes three input parameters: 
@SinceWhen, @RootPath, and @ShowResult. @Since 
When is a datetime value that defines the start time 
when error checking begins. The default is 12 hours 
ago, which ensures that no logs are skipped when a 
server restart happens during off-work hours. When 
a report runs, it typically logs the timestamp in a table 
so that it knows where in the logs to start on the next 
run. Customized reports typically scan the current 
error logs or the entire error log. This approach risks 
skipping logs because they are recycled every time a 
SQL Server service restarts. Another drawback to this 
method is that it repeats old search results. @RootPath 
is where the home working folder resides. Placing it 
at the C root makes the code more portable. @Show 
Result is useful when a DBA wants to run ad hoc 
checks—for example, you can run the following T-SQL 
statement to check all errors for this year: 


EXEC master.dbo.Usp SQLErrorLogReportClient 
'2008-01-01', NULL, 1 


The findstr.exe utility doesn't work with binary files— 
so you can't use findstr.exe to check SQL Server 2005 
logs, because SQL Server 2005 writes error logs in 
binary. The easiest method for searching SQL Server 
2005 logs is to use T-SQL. 

SQL Server 2005 error logs are formatted dif- 
ferently than SQL Server 2000 error logs. The most 
obvious difference is the separation of the log date 
from the log text, which makes sorting by date easy. 
The stored procedure Usp SQLErrorLogReportClient 
has a WHERE clause that filters out a list of search 
strings if the database engine is SQL Server 2005. 


Fine-Tuning 

You can tighten or loosen the search criteria based on 
your environment. For example, if you don't want to 
see the message "SQL Server terminating because of 
system shutdown" when searching SQL Server 2000 
error logs, you can remove the keyword "terminating" 
from findstr_incl.txt (Web Listing 1). Alternatively, 
to avoid other error messages containing the word 
“terminating” from being filtered out, you can add 
the text “terminating because of system shutdown” 
to findstr_excl.txt. For SQL Server 2005 client servers, 
modify the WHERE clause to include the following 
condition in Usp_SQLErrorLogReportClient: 


OR (LogText LIKE N'%terminat%' AND LogText 
NOT LIKE N'%shut down%') 


The DBA should customize the search strings to deter- 
mine what data to include in reports. 


The Central Monitoring Server 
The central monitoring server’s process runs under 
the job in Web Listing 5, which calls Web Listing 6’s 
stored procedure Usp_SQLErrorLogReportServer in 
the master database. Run both listings. Web Listing 5 
loops through a long list of remote client servers and 
extracts their saved error log information. 

Many companies have numerous SQL Server 
systems that aren't always accessible at the same time. 
To avoid interrogating a client server that 1s tempo- 
rarily offline when the server-side job runs, I used the 
odbcping.exe utility to include database connectivity 
checking logic in Usp SQLErrorLogReportServer. 
This tool is a command-shell utility that lets you test 
the ODBC data source’s integrity and the client's ability 
to connect to the server. 

Although odbcping.exe was phased out in SQL 
Server 2005, I’ve found it to be reliable for detecting 
whether SQL Server 2000 systems are accessible. The 
utility isn’t installed by default. You can find it in the 
SQL Server 2000 installation disk’s \x86\binn directory. 
Copy the executable to the C root. You can also down- 
load odbcping.exe from the SQL Server Magazine 
website; go to www.sqlmag.com, enter InstantDoc 
ID 99934, and click the Download the Code button. 
Remote login is required for odbcping to work. Later 
in the article, I discuss a quick way to create a remote 
login on client servers. 

The table to store all error log information on the 
monitoring server is Tbl_SQLErrorLogReport, which 
resides in the tempdb database. This table can accom- 
modate both SQL Server 2005 and SQL Server 2000 
error log formats. If this table generates any entries, the 
Usp SQLErrorLogReportServer stored procedure will 
send an email notification to a defined recipient, with 
the involved client server's name in the header and error 
messages in the body of the message. For email noti- 
fication to work, you must have correctly configured 
database mail on the central monitoring server. Fig- 
ure | shows an email report sent to the DBA group and 
received by a Lotus Notes 7.0 client. 


Mass Operations 
Manually setting up the client processes on a large 
number of SQL Server systems is difficult. In addi- 
tion, modifying the client processes on hundreds of 
servers (e.g., adding a new keyword in the inclusion 
files) is equally tedious. I created the stored procedure 
Usp Mass Operation On АП Clients, which Web 
Listing 7 contains, to handle mass operations on 
SQL Server clients. This procedure includes four 
input parameters: @InputFileFullPath, @HasWrite 
PermissionOnClient, @RootPathOnMonitoringServer, 
and @RootPathOnClient. 

The parameter @InputFileFullPath must be a file 
containing valid T-SQL statements. The parameter 
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ERROR LOG CHECKING 


17:12:24.36 backup BACKUP failed to complete the command BACKUP DATABASE SQLOPS TO DISK = M'\\NASOL\DSA_ceam\Backup\ Sgt 


leg report for 50128001034 


2995-92-27 18:51:15,107 2р2251 


*** Error log герогт for SQLPRODIQSS *** 
Processinfo Text 


Cannot load the DLL храттр%0.211, о: one of the DLL it references. Reason: i26(The specifies module 


2008-02-17 17:29:38.350 
4008-02-17 17:29:38.350 Legen 


ewe Error log report for SQLPROD1078 еее 
LogDate rocessinfo Text 


2008-02-17 16:28:24.490 spid3s 
2098-02-17 16:28:24,490 spid3s 


log report for DBAlestServer *** 
ProcesaIefo Text 


2008-02-17 17:50:29.620 Server 
2208-02-17 17158129.700 Server 
2008-02-17 17:58:25.700 Server 
2008-02-17 17:56:29,709 Server 
2008-02-17 17:58:29. 760 Server 


@HasWritePermissionOnClient is a bit value that 
works solely with DOS commands, such as xcopy. 
When the parameter’s value is 1, the SQL Server 
service account on the central monitoring server has 
appropriate permission on the remote client servers. 
Tf the value is 0, the Mssqlserver account doesn't have 
permission to run command shell commands on client 
servers. In this case, the stored procedure generates a 
result that can be copied and pasted into a batch file. 
You can then run the batch file after you log in to the 
client server via a proper user account. The parameter 
@RootPathOnMonitoringServer is the source file path; 
@RootPathOnClient is the destination file path. They 
are identical by default, but they don’t have to be. 

To begin, create the SQLErrorReport folder under 
the central monitoring servers C root and copy 
findstr. incl.txt and findstr. excl.txt into this folder. The 
SQLErrorReport folder and its contents will be rolled 
out to all the client servers. 

You can use the same stored procedure to also create 
the client-side jobs. Open the SQL Editor on the central 
monitoring server and run the following code (you need 
remote write privileges to execute this code): 


EXEC master.dbo.Usp Mass Operation On АП. 
Clients GInputFileFullPath = 'C:\Client_ 
job.sql', GHasWritePermissionOnClient - 
1, @RootPathOnMonitoringServer = NULL, @ 
RootPathOnClient = NULL 
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SQL Server Наз encountered 
SQL Server has encountered 


Error: 18156, Severity: 14, State: 5. 
Login failed for user 'HRAuditer', 


[CLIENT: 167.43.55.106] 


***Steck Dump being sent to E:\Microsoft SQL Server MSSQL.1 MSSQLALOSNASQLDampOD03. txt 
е BEGIN STACK DUMP: 
* Bon-yielding Resource Monitor 
* Short Stack Dump 
Stack Signature for the damp is 0х0000002000000048 


This code runs the client_job.sql file to create the job 
on all clients, and it copies the SQLErrorReport direc- 
tory and its files to the same locations on all clients. 
Note that the client, job.sql file is the same file as Web 
Listing 4. Also note that the login account and pass- 
word used with the OSQL utility in Web Listing 7 must 
be replaced with appropriate login credentials. 

If you want to add, remove, or modify a search 
string in the inclusion file on all clients, but the central 
monitoring servers SQL Server service account isn't 
able to write to clients, you can make the change in 
the findstr_incl.txt file on the central server first, then 
save the result from running the following code to, for 
example, a file named Update. search. strings.bat. 


EXEC master.dbo.Usp Mass Operation Оп. 
All Clients GInputFileFullPath = NULL, 
@HasWritePermissionOnClient = 9, @ 
RootPathOnMonitoringServer = NULL, @ 
RootPathOnClient = NULL 


Figure 2, page 30, shows the results of running this 
code. Run the batch file under an account that can 
write to the client servers, such as a domain user 
account that is a member of the local administrator 
group on the client servers. Figure 3, page 30, shows 
the results of running the batch file. xS 

You can now automatically create the client 
stored procedure Usp SQLErrorLogReportClient on 


occurrence(s) of I/O requests taking longer than 15 seconds то complete о 
occurrence(s) of 1/0 requests taking longer than 15 seconds to complete o 


Figure | 
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multiple SQL Server systems. You need to save the 
stored procedure (which Web Listing 3 contains) as 
Usp_SQLErrorLogReportClient.sql. Then, run the 
following T-SQL statement to simultaneously create 
the stored procedure on all clients: 


EXEC master.dbo.Usp Mass Operation Оп. 
All Clients @InputFileFullPath = 'C:N 
tempN Usp SQLErrorLogReportClient.sql', 
@HasWritePermissionOnClient = NULL, @ 
RootPathOnMonitoringServer = NULL, @ 
RootPathOnClient = NULL 


To create the client-side login, run the following 
code: 


EXEC master.dbo.Usp_Mass_Operation_On_Al1_ 
Clients ‘C:\temp\Create_OdbcpingLogin_ 
account.sql’, NULL, NULL, NULL 


The code for the Create OdbcpingLogin account.sql 
file is as follows: 


IF NOT EXISTS (SELECT * FROM master. 
dbo.syslogins where [loginname] - 
N'OdbcpingLogin') 

EXEC master.dbo.sp addlogin 
N'OdbcpingLogin', N'Pswd2008' ; 


Refine As You Go 
Although my solution can save DBAs a tremendous 
amount of time and labor, it shouldn't prevent you 
from manually checking your error logs from time 
to time. Regularly investigating logs by hand will 
help you discover events that have been missed by 
the automated process, so that you can update your 
error checking processes in a dynamic database 
environment. Many factors can affect whether your 
automated error checking process works well. When 
rescheduling jobs, make sure the central monitoring 
server job runs after the completion of client-side 
jobs. In addition, if you modify the inclusion or 
exclusion files, be sure to watch for white spaces. You 
don't typically see the hidden blanks in WordPad or 
Notepad but they can cause unexplained problems. 
Finally, remember that each line in the final report 
represents a problem or important event that needs 
further investigation. Although my technique works 
out of the box, it will be most effective if you continue 
to refine it for your environment. 50Ц 
InstantDoc ID 99934 


(C:NSQLErrorReport?Update search strings.bat 


C:NSQLErrorheport*findstr excl.txt 
C:NSQLErrorReport*findstr incl.txt 
2 Files? copied 


C:NSQLErrorReport*findstr excl.txt 
C:NSQLErrorReport*findstr incl.txt 
2 Files? copied 


C:NSQLErrorheport*findstr excl.txt 
C:NSQLErrorReport*findstr incl.txt 
2 File<s> copied 


C:NSQLErrorReport*findstr excl.txt 
C:NSQLErrorReport*findstr incl.txt 
2 File<s> copied 


Figure 3 


Results of running Update search strings.bat 
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C:NSQLErrorReport»xcopy C:\SQLErrorReport\*. txt 


C:\SQLErrorReport>xcopy C:\SQLErrorReport\*.txt 


C:NSQLErrorReport?xcopy C:\SQLErrorReport\*.txt 


C:\SQLErrorReport>xcopy C:\SQLErrorReport\*.txt 


INDOWS'system32\\cmd.exe - Update_search_strings.bat 
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SSUS 


Set up a logging environment using 
Business Intelligence Development Studio 


tions with powerful data 
integration capabilities. To effectively monitor SSIS 
performance, troubleshoot errors, and understand 
data lineage in a production environment, you need 
to implement package logging and data auditing. ГЇЇ 
show you how to use Business Intelligence Develop- 
ment Studio (BIDS) to set up a logging environment 
for managing, monitoring, and troubleshooting pack- 
ages. I review SSIS’s built-in logging capabilities and 
then show you how to customize them. You'll see how 
to incorporate basic data auditing in the package data 
flows. The examples I use include package templates 
along with a logging database and reports (for storing 
and viewing package execution results), which you can 
use as a Starting point in your deployments. 

The logging database and many of the SSIS tasks I 
use come directly from Project REAL. Project REAL 
is a reference architecture and implementation of an 
enterprise-class business intelligence (BI) solution 
based on SQL Server 2005. Microsoft and several part- 
ners used actual customer data to create this reference 
implementation. To learn more about Project REAL, 
see the Learning Path. 

To download the sample code used in this article, go 
to www.sqlmag.com, enter 100005 in the InstantDoc 
ID text box, and click the Chessman_SSISLogging 
code.zip hotlink. The .zip file contains four packages, 
two of which I discuss in this article, and two for your 
future use. I use the 1_ETL_Template.dtsx package to 
show you how to add a log provider to a package and 
then augment the log provider. I use the 2 ЕТІ, Tem- 
plate.dtsx package to give you some Data Flow task 
tips. 


Server Integration Services 
(SSIS) provides organiza- 


Configuring Package Logging 
Package logging refers to writing information about 
the execution results of a package, and its tasks. During 
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package execution, SSIS can log many types of events 
(e.g., status, completion, error information about a 
task) to a variety of destinations, known as log pro- 
viders. A log provider can be a text file, the SQL Server 
Profiler, a SQL Server relational database, a Windows 
event log, or an XML file. If necessary, you can define a 
custom log provider (e.g., a proprietary file format). 
You configure logging at the package level by adding 
a log provider. You can choose to log only certain tasks 
within a package. When designing a package in BIDS, 
click Logging on the SSIS menu to display the Configure 
SSIS Logs dialog box. Use the Providers and Logs tab 
to select a provider to use for the container, as shown 
in Figure 1, page 32. When using the SSIS log provider 
for SQL Server, the Configuration column 
is where you specify a connection to a SQL 
Server database. All the log information is 
written to a table called sysdtslog90, which 
SSIS automatically creates in the database. 


Tyler Chessman 
(tylerc@ microsoft.com) is a Microsoft tech- 


nology specialist who helps Microsofts database 
and business intelligence platform customers. 
Before joining Microsoft, he spent several years 
as a consultant implementing financial, ana- 
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When you've added a log provider to your package, 
click the Details tab and select the events you want to 
log. Some of the event choices include OnError (which 
writes a log entry when an error occurs), OnPost 
Execute (which writes a log entry after a task or 
package finishes running), and OnVariableVal- 
ueChanged (which logs an entry when a variable value 
changes). To prevent the log from becoming unneces- 
sarily large and to avoid degrading performance, log 
only the events you need. 


Opening the Logging Examples 
Now let's put the sample code for this article to use. 
Download it, if you haven't already; then, open the 


Еп. LogAudtoB СЕТЬ 


click the 1 ЕТІ, Template.dtsx package, which you 
can see in Figure 2, to open it in the package designer. 
] ETL Template.dtsx is a basic package that you can 
use as a template for building other packages. 


SSIS Log Provider 

or SQL Server 

The 1 ЕТІ, Template.dtsx package has been con- 
figured to use the SSIS log provider for SQL Server 
and to store the log results (the sysdtslog90 table) in a 
database called ETL_LogAuditDB. Before you run the 
package, restore the database to an instance of SQL 
Server; you'll find a zipped backup of the database in 
the Ше ЕТІ, LogAuditDB zip, which is included with 


po an jewids DeMIme ЦО 
LEN Мйне ӘУ 8 
LED прие ак Li 


LogAuditTemplates.sin file in BIDS from File, Open, 
Project Solution. This solution has two projects: 
LogAuditTemplates and LogAuditReports. In Solution 
Explorer, expand the LogAuditTemplates project and 
the Data Sources and SSIS Packages folders. Double- 


the sample code. If you decide to restore the database 
to something other than a default instance on your 
local machine, you'll need to update the connection 
information for the packages ETL_LogAuditDB.ds 
and ETL LogAuditDB OLEDb.ds data sources. 
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The log provider for the 1 ETL Template 
.dtsx package is configured to log the OnError and 
OnPostExecute events. Limiting logging to these two 
events keeps the logged information to a minimum, yet 
allows you to calculate performance data for each task 
in a package and capture any errors that might occur. 


Augmenting the 

Built-In Provider 

As Figure 2 shows, the 1 ETL, Template.dtsx package 

contains two Control Flow tasks: SQL Audit OnPre- 

Execute and SQL Audit OnPostExecute. These two 

tasks augment the built-in SSIS log provider by 

populating a row in a table named ExecutionLog. The 

ExecutionLog table serves as a header for all the detail 

rows the SSIS log provider writes to the sysdtslog90 

table. The sysdtslog90 and the ExecutionLog tables are 

linked together by a field named executionid, which is a 

GUID generated by SSIS each time a package is run. 

The ExecutionLog table provides a concise sum- 
mary of package execution results (e.g., start time, 
end time, overall status) in a single row, along with 
other useful information. For example, the table stores 
package version information, which can be useful if 
troubleshooting problems resulting from a new version 
of an existing package. 

The SQL Audit OnPreExecute and SQL Audit 
OnPostExecute Control Flow tasks are both Execute 
SQL tasks that call stored procedures in the ЕТІ, _ 
LogAuditDB database. Most of the data passed to the 
stored procedures (e.g, PackageName, PackageID) 
comes from SSIS system variables. The sample uses the 
following three variables, as you can see in the left-hand 
pane in Figure 2. 

* The LogicalDate variable lets you define a “logical” 
processing date, which might differ from the actual 
package execution date. For example, in an extrac- 
tion, transformation, and loading (ETL) process 
you might need to load data from a specific time 
period (e.g., all of the new sales entries from a given 
fiscal period) or you might need to perform a net 
data capture based on the last successful execution 
date of the package. In these scenarios, a date value 
needs to be stored and then read/updated by the 
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package during execution. 

* LogID is an integer that uniquely identifies a 
package execution and is generated via an identity 
column in the ExecutionLog table. 

* ParentLogID is simply the LogID of a “parent” 
package. In other words, if the package is invoked 
from another package, the ParentLogID value 
will be equal to the LogID of the calling (1е., the 
parent) package. To pass the LogID from the parent 
package, you use a package configuration. To view 
the package configuration, select Package Configu- 
rations from the SSIS menu. 


Error Handling 

As I mentioned, the SSIS log provider for the 1_ETL_ 
Template.dtsx package is configured to log OnError 
events. Additionally, the package contains a package- 
level OnError event handler consisting of an Execute 
SQL task named SQL OnError, which updates the 
ExecutionLog table if an error occurs. 


Package logging refers to writing 


Figure 3 


A sample Package- 
Execution Details 
report 


information about the execution results 

of a package and its tasks. During package 
execution, SSIS can log many types of events 
(e.g., status, completion, error information 


about a task) to a variety of 


destinations, known as log providers. 


Viewing Package Results 

From the Solution Explorer in BIDS, right-click the 
] ETL Template.dtsx package and select Execute 
Package. After the package runs, you can use SQL 
Server Reporting Services (SSRS) to view the logged 
events. 

In Solution Explorer, expand the LogAuditReports 
project and the Reports folder. Double-click the 
PackageExecutionDetails.rdl report to display Report 
Designer. Click the Preview tab, select a Package Name 
and Execution Run value, and then click View Report. 
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Figure 4 


Data Flow Task for 
ETL_Template.dtsx 
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The report will look similar to the Package—Execution 
Details report in Figure 3, page 33. This report shows 
you when the package ran, who initiated the package 
and from what computer, the total package runtime, 
and the time it took to complete each task. If an error 
occurs, information about the error will also be listed 
in the message column. 


Data Flow Performance and 
Data Auditing 

The second package in the sample download, 2_ETL_ 
Template.dtsx, incorporates performance tracking 
and data auditing (sometimes referred to as data lin- 
eage) into a Data Flow task. Open the package in the 
package designer and click the Data Flow tab. In this 
example, shown in Figure 4, I select a set of records 
from a source system (in this case, the Adventure- 
Works sample database) and then eventually output 
the records to a Row Count component. Let's examine 
the two components in the middle, STAT Source and 
DER Audit. 

STAT Source is a script component that mea- 
sures the number of rows flowing through a Data 
Flow task, along with the minimum, maximum, and 
mean throughput per second. The results are stored 
in the StatisticLog table. You can include multiple 
STAT Source components in a Data Flow (be sure 
to give each component a unique name) to measure 
throughput at multiple points in the flow. In the 
LogAuditReports project, I've included another report, 
PackageProgressByExecutionTime.rdl, that provides 
a summary of package execution results by date and 
includes data from the StatisticLog table for packages 


Source component. 

DER Audit is a derived column 
component that adds two impor- 
tant pieces of information into 
the Data Flow—LogID and Last- 
ModifiedDate. This information 
is meant to be written to your 
destination source(s) so you have 
a way of mapping back to the 
package responsible for writing 
the data. If you use another means 
of inserting or updating data in a 
destination system, such as Execute 
SQL tasks, make sure to add these 
derived columns. 


Next Steps 

Tve included two more packages 
for you to examine on your own. 
3 ETL MP Template.dtsx is an 
example of a parent package that 
calls a child package. 4 ЕП. 
Package-WithError.dtsx includes an intentional error in 
the data flow so you can see what an error looks like in 
the sample reports. 

How do you use these packages in your environ- 
ment? You can make a copy of the LogAuditTemplates 
project (updating/adding Data Sources as needed) and 
go from there. Or, you can add one or more of the 
individual packages to your existing SSIS projects and 
customize as needed. Note that each package contains 
a property named ID, which is a GUID that uniquely 
identifies the package. When you copy a package, this ID 
doesn't change. To cleanly separate data in (һе ЕТІ, Log 
AuditDB database, you should not only rename the 
package but also generate a new GUID. To generate 
a new GUID in BIDS, select the drop-down arrow in 
the ID column of the Properties pane of the Package 
Designer and select Generate New ID. 

Finally, there are a few components in the ETL 
LogAuditDB database I didn't cover. You can use 
the ExecutionLog table to track performance of SQL 
statements run in a destination system. You can use 
the ProcessLog table to manage partitioned tables. 
The Project REAL ETL white paper discusses these 
components in greater detail. 

To recap, I’ve reviewed SSIS's built-in logging 
capabilities and then shown you how to augment 
them. I also incorporated performance tracking and 
data lineage into the package templates for auditing/ 
troubleshooting purposes. These templates, along with 
the ETL LogAuditDB database and sample SSRS 
reports, can serve as a starting point for ETL solutions 
you deploy in the future. 500] 
InstantDoc ID 100005 
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Generating 
Server-Side Traces 


See how easily you can capture trace data 
without SQL Server Profiler 


6 ince the publication of my performance-compar- IDs are listed in BOL under the sp trace setevent 

ison article, "SOL Server Profiler or Server-Side command, which you see in Listing 2. You need 

Trace?" August 2008, InstantDoc ID 99365, I’ve received to call this command once for each event/column 

many requests for more information about how to use pair. For the sake of brevity, I haven't listed all the 

server-side traces. To satisfy those requests, I'd like to columns for each event; you can add or delete any 

offer a trace-creation overview, and—next time—follow that you feel necessary. However, one column that 

that up with a look at how to process the gathered many people tend to forget is the Database ID 

information. column, which lets you see which databases you're Andrew J. Kelly 
Because most people seek performance-related accessing. 

information (e.g., trace duration, CPU used, number of 3. You can set a filter condition to limit which data = t ч si m 

reads and writes performed), I'll focus on capturing such or how much data you want to capture. Listing 3, s ын s a iit E 

metrics by using the two most commonly used trace which shows the sp trace setfilter command, shows has 20 years experience with relational 

events: RPC:Completed and SQL:BatchCompleted a filter of READS >= 5000. Adding such a filter databases and application development. He 

(which correspond to the Event Class IDs of 10 and can dramatically reduce the amount of mundane is a regular speaker at conferences: and 

12, respectively). Together, these two events will capture or unwanted data and help you ensure that server SMS 

every request sent to SQL Server from any client. The performance isn't affected. But first be sure that you 

RPC event will capture all stored procedure calls that understand what you might be filtering out so that 

the client executes, and the BatchCompleted event will you don't miss any important or relevant data. 

capture everything else. Note that these events don't 4. To start the trace and begin the data collec- ORE on the WEB 


capture the individual statements within the procedure tion, use the sp trace setstatus command, 
or batch, but you can easily capture these items by which Listing 4, page 36, shows. A value 
using other available events. 


Download the listings 


LISTING 1: The sp trace create Command 
Beginning CU 
-- Create a trace definition 

the Trace declare @rc int, GTraceID int, @maxfilesize bigint ; 
Your goal is to create a server- Set Gmaxfilesize = 50 
side trace that will capture the 
events you're interested in and 
store them in one or more files on a locally attached 
disk on the server. This tactic ensures a minimal hit -- Set the events 
on server performance while the trace is active. (All of declare Gon рї; ser Gon = 1; 
this article’s commands are fully documented in SQL -- RPC:Completed 

. exec sp trace setevent @TraceID, 10, 1, Qon -- TextData 
Server Books Online—BOL—so be sure to read the exec sp trace setevent @TraceID, 10, 3, боп -- Database ID 
available documentation to determine exactly how you 


LISTING 2: The sp trace setevent Command 


22 : А . exec Sp trace setevent @TraceID, 10, 13, Qon -- Duration 
want to utilize the trace options to suit your specific exec sp trace setevent @TraceID, 10, 16, @on -- Reads 
: : : exec sp trace setevent GTraceID, 10, 48, Qon -- RowCounts 
needs.) To accomplish this goal, you can use a series of 


T-SQL commands, which I've broken into groups for s sop React om етей C T 
4 4 В exec sp trace seteven race , , on == lextData 
this article. You can download the full sample script exec sp trace setevent @TraceID, 12, 3, Qon -- Database ID 

at www.sqimag.com, InstantDoc ID 99940. 

1. Create the trace definition, and specify how you 
want the trace to behave (e.g., the name and 
location of the resulting file or files). Listing 1’s LISTING 3: The sp_trace_setfilter Command 
sp_trace_create command accomplishes this step. == Get dha Piles 

2. Add the events and columns that you want to declare @bigintfilter bigint; set @bigintfilter = 5000; 


А exec sp trace setfilter GTraceID, 16, 0, 4, Gbigintfilter 
capture in the trace. All the event and column 


exec sp trace setevent @TraceID, 12, 48, доп -- RowCounts 
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at 


InstantDoc ID 99940. 


exec йгс = sp trace create @TraceID output, 2, N'Insert Path & FileNameHere', @maxfilesize, NULL 
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LISTING 4: The sp_trace_setstatus Command There are many events and columns to choose 
————— — fro, of course, and І wouldn't expect anyone to 
e a um Ou 1 memorize them all. As I mentioned, BOL documents 
: А them well. But there's an easy way to get started. 
-- display trace id for future references REA . 
select TraceID-GTraceID You're probably already familiar with SQL Server 
Profiler and know how to choose the events and 
А SQL Sener Profier {United 2 ПАТО? 59005061 ШЕ ` columns you want to capture. Once you have SQL 
| | (Не) ёа Мен Replay Тоон Window [ET = -**|| Server Profiler set the way you want it, simply choose 
| 


"ПЕ 


Export from the File menu, as Figure 1 shows. You'll 
be able to save a script that has all the proper com- 
mands to create a trace just as you defined in SQL 
Server Profiler. Remember, however, that you'll need 
to specify options for the sp_tracecreate command 
that will tell it exactly how you want the trace to 
behave, as outlined above. 


Script Trace Definition » For SQL Server 2005... 
Extract SQLS в For SQL Server 2000... 


Extract SQL Server Analysis Services Events  »| | Fer Analysis Services 2005 Now What? 
Once you have the trace files, you can view them by 
of 1 starts the trace, a value of 0 stops the trace (but ^ loading them into SQL Server Profiler or by using 


Figure | 
Exporting from SQL 


Server Profiler retains the definition in memory so that you can the fn_trace_gettable() function with T-SQL to read 
restart it if necessary), and a value of 2 removes a them directly. Next time, ГЇЇ explore how to use this 
closed trace definition altogether. Once the trace has function (along with several others) to read, parse, 
begun, you should display the trace ID for future and aggregate the information into something that 
reference. Be aware that trace IDs are reused, so if will help you better understand the metrics you’ve 
you close a trace definition and create a new опе, you captured. 500] 
might or might not get the same ID as before. InstantDoc ID 99940 
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In Lesson 8, discover how useful 


-SQL has many built-in functions that come 

i in four basic flavors: aggregate, ranking, 

rowset, and scalar. You've already been 
introduced to aggregate functions, which take in sets 
of data and return a single aggregated value. Because 
I covered several aggregate functions in “T-SQL 101, 
Lesson 3,” May 2008, InstantDoc ID 98315, I won't 
cover them here. 

Ranking functions are used to determine the 
particular rank of a record in a portion of a result 
set. Rowset functions generate a result set that can be 
referenced in T-SQL statements as if it were a table. 
Due to the complex nature of the ranking and rowset 
functions, they're beyond the scope of this lesson. If 
you'd like to find out more about them, see the SQL 
Server 2005 Books Online ( BOL) documentation at 
msdn.microsoft.com/en-us/library/ms189798.aspx for 
ranking functions and msdn.microsoft.com/en-us/ 
library/ms187957.aspx for rowset function. 

Scalar functions can accept one or more input 
parameters but return only a single value as output. 
You can use scalar functions in any valid expression, 
including another scalar function, so you can use them 
to perform a wide variety of operations. You can use 
scalar functions for converting dates, truncating strings, 
and even performing advanced mathematical operations 
that involve trigonometry. In this lesson, ГЇЇ introduce 
you to several common scalar functions used for 
working with dates and manipulating strings. ГЇЇ leave 
the trigonometric functions for a much later lesson. 


The Prerequisites 

To follow along with the examples in this lesson, make 
sure your MyDB database contains the following: 

* The Employee table created in Lesson 3 

* The vMovieReviewSummary view created in Lesson 7 


If you haven't created this table and view, you'll find the 
code to do so in the 99832 71р Ше. To download this file, 
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scalar functions can be 


go to www.sglmag.com, enter 99832 in Ше InstantDoc 
ID text box, and click the 99832.zip hotlink. 


Functions for Working 

with Dates 

DBAs commonly work with dates, so let’s start by 
examining three date-related functions: GETDATE, 
DATENAME, and DATEADD. 

GETDATE. In T-SQL, you can use the GETDATE 
function to obtain the current system date and time. 
Although GETDATE doesn’t have any input param- 
eters, you still need to include the parentheses in your 
code because that's how SQL Server typically identifies 
functions. To use this function, you include it in a query 
statement such as 


SELECT СЕТОАТЕ() AS 'Current Date/Time' 


Because you're accessing the GETDATE function from 
within a SELECT statement, the result is treated as if it 
were a column being retrieved from a table, like this 


Current Date/Time 


2008-05-31 22:20:52.917 
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2008-06-01 20:41:20.403 2008-06-01 08:41:20.403 


Figure | 


Sample results from 
using the DATEADD 
function 
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DATENAME. Now let's say you want to deter- 
mine on what day of the week a particular date will 
occur. You could write some complex calendar code, 
or you could use the DATENAME function. As the 
following syntax shows, DATENAME requires two 
input parameters: 


DATENAME(datepart, date) 


The datepart parameter specifies the part of the date to 
retrieve, and the date parameter specifies the date. For 
example, to determine on what day of the week New 
Year's Eve occurs this year, you'd execute the code 


SELECT DATENAME (dw, ' 2008-12-31') 
AS 'New Year''s Eve' 


which would give you the result 


New Year's Eve 


Wednesday 


This example uses dw as the first input parameter, 
which tells SQL Server that the part of the date you 
want to retrieve is the day of the week. There are 11 
datepart parameters you can specify, including mm or 
m for month and dy or y for day of the year (e.g., day 
360 of the year). You can read more about the other 
datepart parameters in the SQL Server 2005 BOL 


documentation at msdn.microsoft.com/en-us/library/ 


ms174395.aspx. 

SQL Server automatically converts strings to date- 
time values if the data is in a recognized format. In this 
example, the date passed to the DATENAME function 
was specified as a string in the format Y Y YY-MM-DD, 
which SQL Server recognizes. Because a time wasn’t 
specified, SQL Server assumes the time is midnight. 

In the SELECT statement's AS clause, note the two 
apostrophes (i.e, single quotes) in the column name. 
Because single quotes are used to denote the start and 
stop of character strings, you have to specify two single 
quotes if you want the string to contain an apostrophe. 


12 Hours Ago 


DATEADD. |f you need to add or subtract a 
specified period of time from a date, you can use the 
DATEADD function. This function has three input 
parameters: 


DATEADD(datepart, number, date) 


You use the first parameter to specify the part of the 
date you're interested in adding time to or subtracting 
time from. Valid datepart parameters include hh for 
hour, dd or d for day, and yyyy or yy for year. (You 
can find a comprehensive list of datepart parameters 
for the DATEADD function at msdn.microsoft.com/ 
en-us/library/ms186819.aspx.) The second parameter is 
an integer that specifies how many of the time periods 
specified by datepart to add or subtract. You need to 
use a negative value to indicate subtraction. The third 
parameter is a valid string that specifies the date you 
want to add time to or subtract time from. 

For example, to find the date seven days after New 
Year's Eve, you'd use the code 


SELECT DATEADD(d,7, '2008-12-31') 
AS '7 Days Later' 


The results would look like 


7 Days Later 


2009-01-07 00:00:00.000 


To determine the current date and time as well as the 
date and time 12 hours ago, you can use the GET- 
DATE and DATEADD functions in the statement 


SELECT GETDATEO AS "Мои", 
DATEADD(hh, -12, GETDATEO) 
AS '12 Hours Ago' 


As this statement demonstrates, you can embed 
GETDATE within another scalar function. The order 
of precedence dictates that innermost functions are 
executed first. Figure 1 shows sample results from this 
statement. 


Functions for 

Manipulating Strings 

T-SQL has more than 20 string-manipulation func- 

tions that let you perform all sorts of useful opera- 

tions ranging from simple string truncation to the 

more complex search and replace. Com- 
monly used string-manipulation functions 
include LEFT, RIGHT, SUBSTRING, 
and REPLACE. 

LEFT and RIGHT. The LEFT and 
RIGHT functions return a specified 
number of characters from the left or right 

side of an input string. These functions' syntaxes are 


LEFT(character exp, integer exp) 
RIGHT(character exp, integer exp) 


where character exp 1s the character expression and 
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integer exp is an integer that specifies 
the number of characters to return from 
either the start of the character expression 
(LEFT function) or the end of the character 
expression (RIGHT function). A character 
expression can be a hard-coded string, a 


column of characters from a query, or binary data 


from a query. 


To see these two functions in action and compare 


their differences, execute the code 


SELECT LEFT('ABCDEFGH',4) AS 'First 4', 
RIGHTC'ABCDEFGH',4) AS 'Last 4" 


The results are 


First 4 Last 4 


ABCD EFGH 


SUBSTRING. The SUBSTRING function 
returns a portion of a string. It has three input 
parameters: 


SUBSTRING(expression, start, length) 


The first parameter is the expression (character 
string, binary string, text, image, or column) 
from which the substring will be retrieved. The 
second parameter is an integer that specifies 
the start position of the desired substring within 
the expression. The third parameter is an 
integer that indicates how many characters to 
return. 

For example, the following code returns sev- 
eral substrings from hard-coded strings: 


SELECT 'ABCDEFGH' AS 'String', 
SUBSTRING('ABCDEFGH' ,1, 5) 
AS 'First Five', 
SUBSTRING('ABCDEFGH' ,2,6) 
AS 'Middle Six', 
SUBSTRING('ABCDEFGH' ,6, 3) 
AS 'Last Three' 


As you can see in the results in Figure 2, by speci- 
fying different starting positions and lengths, you 
have full control over the substring returned by 
the function. 

Now let’s see how the SUBSTRING function 
can be used to extract substrings from columns 
in a table. Run the following query against the 
Employee table: 


USE MyDB 
SELECT FirstName, LastName, 
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String First Five Middle Six Last Three 


Figure 2 


Sample results from 
using the SUBSTRING 
function to extract 
substrings from a 
hard-coded string 


SUBSTRING(FirstName,1,4) + 
SUBSTRING(LastName, 4,4) AS 'NickName' 
FROM Employee 
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william 
Garret 
Raoule 


Garth 
Bill 
Napolean 
Michael 
John 


Figure 3 


Sample results from 
using the SUBSTRING 
function to extract 
substrings from a 
column 
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LastName NickName 
willvoy 
Garrters 
Raouebla 
Garter 
Billmond 
Naporenc 
Michth 
Johnth 


Testerson 
Teteblanche 
Vader 
Diamond 
Lawrence 
Smith 

Smith 


This query uses two SUBSTRING commands. The 
first command is run against the FirstName column 
and generates a substring of the first 4 characters of 
each employee’s first name. The second command is 
run against the LastName column and attempts to 
generate a substring four characters long, starting at 
position four. I said “attempts to generate” because 
some of the last names don’t have four characters 
starting at position four. For example, the last name 
of Smith has only two characters (th) starting at that 
position. In such cases, the function simply returns 
what's there and doesn’t generate an error. The results 
of the two substring commands are concatenated (1.е., 
added together), providing a list of silly nicknames for 
the employees, as Figure 3 shows. 

REPLACE. The REPLACE function finds every 
occurrence of a substring inside a string, then replaces 
the old substrings with a new substring. This function 
has three parameters: 


REPLACE(original_string, 
string_to_find, replacement_string) 


The original_string parameter is the string to be searched. 
The string_to_find parameter is the substring you want 
to find and replace. The replacement_string parameter is 
the replacement substring. For example, the code 


Meet the Clusters 

Defragger Hill 

Planet Of The Ape-Like DBA's 
The User who Knew Too Much 


Bridge Over The River Motherboard 
When Harry Re-Indexed Sally's Table 
V for Vendor 

Bits, Bytes, Videotape 

The Perfect Requirements Document 
Chariots of Firewire 


ке 


ке 


SELECT 'I talked the так." 
AS 'Before', 
REPLACE('I talked the talk.', 
'alk','ank') AS 'After' 


searches the string J talked the talk, replacing every 
occurrence of the substring alk with ank. Here are 
the results: 


Before 


I talked the talk. I tanked the tank. 


The length of the substring being replaced doesn't 
have to match the length of the replacement substring, 
as this example shows 


SELECT Movie, Stars, 
REPLACE(Stars, '*' , 'STAR') 
AS 'Replaced' 

FROM vMovi eReviewSummary 

ORDER BY Stars 


Figure 4 shows the results. 


A Little Research 
Can Save You a Lot of Time 
When it comes to built-in T-SQL functions, I’ve barely 
scratched the surface. I hope that what I covered in this 
lesson will give you a basic understanding of how to 
use scalar functions in your own queries and where to 
find out about the other types of built-in functions. 
Don't be like one of my colleagues who was shocked 
when I removed about 500 lines of buggy code from 
his stored procedure and replaced it with a single 
REPLACE command. It amazes me how much effort 
people pour into reinventing the wheel because they 
don’t bother to do a little research upfront. Me? Гл 
too lazy to be inefficient! [SOL | 
InstantDoc ID 99832 


Replaced 


STAR 

STAR 

STAR STAR 
STAR STAR 
STAR STAR STAR 


Figure 4 


Sample results from using the REPLACE function 
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Sharpen Your Basic 
SQL Server Skills 


7 guidelines for query optimization 


Q: What do you recommend for optimizing queries? 

A: You should optimize every query so it runs as 
efficiently as possible. I follow seven generic guidelines 
when I optimize queries. Look at every query carefully 
and optimize based on additional factors such as I/O 
cost, current workload on the server, and so on. 

Review the query execution plan. 'To locate the execu- 
tion plan, in SQL Server Management Studio (SSMS) 
Query Editor, click Query on the top menu bar, then 
select Include Actual Execution Plan. Run the query, 
and select the Execution Plan tab in the results pane to 
view the execution plan for the query. Look for the most 
expensive operation and start optimizing there. 

Update column statistics. If a column in a table 
1501, indexed, the SQL Server query optimizer uses the 
statistics for that column to create an optimal execution 
plan. This improves the performance of the query even 
though there’s no index on the column. Sometimes 
using column statistics results in better performance 
than using an index on a column, but only if the 
statistics are current. To obtain current statistics, use 
the UPDATE STATISTICS command. In most cases, 
column statistics are already created when columns are 
used in query conditions (e.g., when using WHERE 
clauses or JOINS). 

Optimize Index Scan, Table Scan, and Bookmark 
Lookup. ЇЇ you find Index Scan, Table Scan, or Book- 
mark Lookup in the query execution plan, it typically 
means that your query needs improvement and your 
indexes aren’t being used. Find columns without 
indexes used in the query and create an index on each 
of those columns. Test each column to see if perfor- 
mance improves. Where more than one column is used 
to create an index, you can create a covering index. A 
query that contains the same columns as a covering 
index can be optimized if the covering index is used in 
that query’s execution plan. 

Index columns used in an ORDER BY clause. Often, 
data returned from a query is expected in a certain 
order. If you need data ordered by a specific column, 
then index that column. If you need data ordered by a 
specific column, then indexing that column will provide 
better performance. For example, in a table containing 
a column of country names, if the names of the coun- 
tries need to be in descending order, create an index 
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on the country column in the table. In the following 
example, I specified the DESC option when I created 
the index: 


CREATE INDEX i CountryNames ON Country 
This index helps resolve a query such as 


SELECT CountryNames FROM Country ORDER 
BY CountryName DESC 


Avoid functions on columns. If you use a function 
in the WHERE clause or in a JOIN clause, doing so 
will force the query optimizer to scan the whole table 
instead of taking advantage of an available index. 
When you use a function on the column, the query 
optimizer doesn’t know what the resulting column 
value will be until it runs the function on the whole 
column, which creates a table scan. 

The use of a function on a column might reduce per- 
formance. If this happens, here's a workaround that I use: 
I create a computed column in the table that applies the 
function on the desired column. Then I create an index 
on the computed column and use the computed column 
wherever I need to use the function. By doing this, I 
reduce the need for a table scan, the query optimizer 
can choose to use the index, and query performance is 
improved. the following are examples of functions on 
columns; both of which will create table scans: 


HAVING MAX(Column) > 1 


INNER JOIN .. ON Тар1е1.СоТитп = LTRIM(@ 
SearchVar) 


Use a separate hard disk and hard disk controller for 
storing indexes and the tempdb database. | recommend 
that you create tempdb and all the indexes on a sepa- 
rate hard disk. Doing so will improve performance for 
queries because multiple disk controllers will improve 
the performance for disk I/O. 

Follow your intuition and test with many methods. 
There isn't a single method by which all queries can be 
optimized. The query optimizer selects the best execu- 
tion plan (the most efficient index) for the queries, but 
sometimes it's not the optimal plan. You can have the 
query optimizer create alternative optimized plans. ET 
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Pros: SQL Comp 
use, and pays for 
hours of effort. 


Cons: Pricing for the Pro E 


compared to the Standard Edition. 


Rating: Ж Ж ЖЖЖ 


Price: Standard Edition starts at $395 for a single 
license ($494. including support and upgrades), 
and Pro Edition starts at $595; volume discounts 
are available. SQL Compare can also be purchased 
bundled with other Red Gate Software solutions at 


discounted prices (e.g., the 
dle is $595 and includes S 


Compare, and SQL Dependency Tracker). 


Recommendation: This product is ideal for 
environments in which database developers are 


constantly making changes 


development into testing and staging, and then into 


production. It allows develo 
changes easily. 


SQL COMPARE 6.2 


SQL Compare 6.2 


Е ог DBAs and database developers in busy devel- 
opment environments, keeping track of code or 
schema changes as they progress from development, 
to testing and staging, and then to production can 
be tedious and time-consuming. Tracking changes 
is especially complex in organizations with multiple 
sites or servers. Fortunately, Red Gate Software’s SOL 
Compare 6.2 addresses database differencing and syn- 
chronization with aplomb, by making it possible to see 
which differences exist. You can also selectively remove 
those differences by synchronizing schema and code 
between databases with the click of a few buttons. 

SQL Compare is easy to install and use. You use a 
wizard to create a comparison project, then you specify 
the location or connection information for the two data- 
bases that you want to compare. SQL Compare then 
scripts the objects in both databases and compares them. 
It sorts comparison results into one of three logical 
groupings: objects that exist in both databases but are 
different, objects that exist in only one of the databases, 
and objects that are identical in both databases. You can 
expand or collapse these groups to review differences. 
You can even group, 
or sort, your objects by 
object type. SQL Com- 
pare includes an array of 
filters that you can use to 
select the objects whose 
differences you want to 
view. It also provides the 
ability to let you ignore 
certain comparison differ- 
ences (such as comments 
and white space or even 
indexes and constraints), 
which makes it easy to 
fine-tune each comparison 
project. 

Click any object in the 
SQL Compare window 
to display creation scripts 
for that object in the SQL 
Differences panel, which 
is docked, by default, at 
the bottom of the screen. 


are is intuitive, easy to 
itself quickly by saving 


dition seems a bit steep 


SQL Comparison Bun- 
QL Compare, SQL Data 


and pushing them from 


pers and DBAs to track 


Contact: Red Gate Software е 866-733-4283 е 


www.red-gate.com. 
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However, you can undock 
it and display it on a 


second monitor. The SQL Differences panel shows 
a side-by-side comparison of object scripts and high- 
lights where lines don't match up. It also groups dif- 
ferent types of scripts for each object (such as tables, 
constraints, sprocs, udfs, and so on), which makes it 
easy to inspect differences at a glance. With tables, for 
example, SOL Compare groups scripts into collapsible 
regions for Columns, Constraints and Indexes, and 
Full Text Information. SQL Compare does more than 
just compare tables: It provides support for every kind 
of object found in SQL Server, including users and 
roles and all of the objects supported by SQL Server 
2005 such as partition schemes, certificates, and CLR 
assemblies. 

Synchronization, which makes SQL Compare an 
incredible product, is easy to start. Select the objects in 
the SQL Compare window that you want to synchro- 
nize, and click Synchronization Wizard. In the wizard, 
specify the direction in which you want your changes 
to flow (eg., should objects in database A look like 
objects in database B, or vice versa?) and then review 
any potential warnings or dependencies. You can specify 
whether you want to execute the changes immediately or 
export them to a T-SQL script to manually implement 
later. SOL Compare creates a transactionally safe script 
that won't negatively affect your database if a problem 
with underlying data results in an error. If you execute 
the changes immediately, SOL Compare gives you the 
option to compare databases again after the synchroni- 
zation script has been fired to make sure that targeted 
objects have been correctly synchronized. 

In addition to providing comparison functionality 
for live databases, SOL Compare lets you make com- 
parisons between snapshots (Le. persisted copies of 
database objects made previously by SOL Compare) 
and folders full of raw scripts SQL Compare Pro 
Edition offers integration with source control, making 
it possible to compare live databases with their “con- 
trolled” counterparts. A command-line version of SQL 
Compare Pro is available for advanced users. 

You can evaluate SQL Compare by downloading a 
fully-functional 14-day trial version. If you're a database 
professional who has to deal with lots of schema changes 
between different versions (development, test, staging, or 
production) of databases, then SQL Compare is one tool 
that you really can’t afford to be without. 500] 
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SQL Nitro 2.0 


BNitro’s SQL Nitro 2.0 is designed to boost the 

performance of your SQL Server applications, 
and let’s face it: Improved performance is something 
we're always looking for. 

Unlike many performance-enhancing applications 
that attempt to optimize queries or perform other 
tuning tricks on the SQL Server engine, SQL Nitro 
works at the network level. SQL Nitro compresses the 
Tabular Data Stream (TDS) that SQL Server uses to 
communicate with networked clients. This approach 
doesn't require any changes to be made to SQL Server 
or to the networked applications. 

DBNitro’s website (www.dbnitro.com) claims the 
product can provide twice the speed and use half the 
bandwidth of the native SQL Server client libraries. 
Because SQL Nitro works with SQL Servers TCP/IP 
client libraries, it needs to be installed on both the SOL 
Server system and the network clients that connect to 
the SQL Server system. 

One installation program is used to install SQL Nitro 
on both the clients and the SQL Server system. Installing 
SQL Nitro 2.0 was quick and painless, taking only a few 
seconds on both the client and the server. The SQL Nitro 
installer installs the SQL Nitro Control Console, as well 
as DLLs that work with SQL Servers TCP/IP client 
libraries to compress the TDS. SQL Nitro Control 
Console lets you turn SQL Nitro on and off, as well as 
track real-time compression statistics. Figure 1 shows the 
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Total compressed bytes: 
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Figure 1 
SQL Nitro Control Console 
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SQL Nitro Control Console. 

To test SQL Nitro 2.0, I ran a set of 30 queries 
between a Windows XP client and my SQL Server 2005 
test server and recorded the total time for completion. 
First, I recorded the time it took to run a single connec- 
tion. Then I reran the tests with 10 connections from 
the client system. Web Figure 1 (www.sqlmag.com, 
InstantDoc ID 100031) shows a comparison of the query 
results before and after SQL Nitro 2.0 was installed. 

In my testing, I found that SQL Nitro 2.0 did 
reduce network bandwidth utilization, as I saw com- 
pression ratios of as much as 9:1 (93 percent). However, 
it didn't significantly change the overall response time 
of my test queries. As you can see in Web Figure 1, I 
saw a slight decrease of about 2 seconds (1 percent) in 
application response time while running SQL Nitro 
2.0. That said, my 100MB test scenario had plenty of 
network bandwidth. 

SQL Nitro supports SQL Server 2005 and SQL 
Server 2000. At the time of this review, SQL Nitro didn't 
include support for SQL Server 2008, Windows Server 
2008, or Windows Vista; however, DBNitro 
plans to include support for these products in 
a future SQL Nitro release. 

SQL Nitro 2.0 isn’t a panacea for SQL 
Server performance problems. In high- 
bandwidth situations, such as in my test scenario, it 
improved performance only slightly. However, it did 
achieve high rates of compression, which 
could make it more effective in situations 
in which network bandwidth limits the 
performance of your SQL Server systems. 
SQL Nitro is easy to install and turn on 
and off, so trying the product in your envi- 
ronment is risk free. 500] 
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Read the full review and see 
the web figure at InstantDoc 
ID 100031. 


Pros: Easy installation, informative management con- 
sole, no impact on non-SQL Nitro connections 


Cons: Limited performance improvement in high-bandwidth 


Price: Starts at $995 for SQL Nitro for SQL Server Production 


Recommendation: SQL Nitro isn't recommended for SQL 
Server installations with adequate bandwidth. However, it could 
be useful for servers constrained by network bandwidth. 
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elatera 


be-1 la-t(o-)ral 
(adj.): of or 
relating to both 
the front and back 
ends of business 
intelligence 


WI ndows from the top BI experts such as 
IT p Derek Comingore, Dan Holme, Michelle A. 
ro Poolet, and Rodney Landrum. 


the best platforms and reports with 
help from SQL Server Magazine. 


Галл етет. . В 
data-delivery with front-end 


solutions in Windows IT Pro magazine. 


how-to information, industry trends, 
and commentary by experts with the 
new Essential ВІ UPDATE e-newsletter at 
www.windowsitpro.com/email. 


NEW PROU 


BUSINESS PERFORMANCE Q Editor's Tip 
Smart Financial Performance Management 


PROPHIX Software has enhanced PROPHIX for SQL Server, its financial Got a great 
performance management solution. The new version's web-based advanced data — new product? 
visualization provides a graphical overview of an organization's performance and ^ Send announce- 


interactive dashboards. Offline data entry lets users enter data withoutloggingin ments to products @ 
sqimag.com. 
—Jeff James, 
senior editor 


to PROPHIX. Enhanced auditing functionality tracks events and lets users see 
information about accounts that have been added, which can help with Sarbanes- 
Oxley compliance. The product also logs changes in workflow projects. Pricing 
begins at $20,000 for a 10-user system. For more information, contact PROPHIX 
Software at 905-279-8711 or visit www.prophix.com. 


APPLICATION MONITORING 
Application Life Cycle Monitoring 

AVIcode recently announced the availability of Intercept Studio 5.0, a solution for monitoring applications 
throughout their life cycles. A new Incremental Application Dependency Discovery feature provides information 
about all application dependencies and database resources, such as SQL Server, Oracle, and DB2. The new ver- 
sion also offers extended platform support for Visual Studio 2008, Language-Integrated Query, Windows Server 
2008, Microsoft .NET Framework 3.5, Windows Workflow Foundation, Sybase, and Microsoft Data Access 
Components. Pricing begins at around $16,000 for one monitored server. For more information, contact AVIcode 
at 443-543-0030, or visit www.avicode.com. 


BUSINESS INTELLIGENCE 

A Hybrid Approach to ВІ 

Panorama Software has released the latest version of its NovaView business 
intelligence (BI) suite. The new version uses a hybrid approach to BI that lets 
organizations keep their data warehouses inhouse while continuing to use 
Panorama’s Software as a Service (SaaS) product, PowerApps, for BI collabora- 
tion. NovaView 5.5 also includes a new UI, integration with Google Docs and 
Google Apps, and new RSS functionality. For more information, call 416-545- 
0990 or go to www.panorama.com. 


Fe men We Re am ж 


po iiia PERFORMANCE 
MONITORING 


Find, Diagnose, and Optimize 
Inefficient SQL Code 

Embarcadero Technologies has released DB 
Optimizer, its new SQL profiling and tuning 
IDE. DB Optimizer finds and diagnoses 
poor-performing SQL code in production 
databases and applications and optimizes 
inefficient SQL statements. The product also 
provides a graphical visualization of wait- 
time analysis, feedback about how to solve 
coding problems, and batch tuning of Data 
Manipulation Language statements and stored routines. DB Optimizer supports SQL Server, Oracle, Sybase, 
and DB2 platforms and is available for $1,500 per license. For more information about DB Optimizer, call 415- 
834-3131 or go to www.embarcadero.com. SU} 
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LEARNING PATH 
SQL SERVER MAGAZINE RESOURCES 


Bytes from the Blog 
www.sglmag.com/go/industrybytes 


Microsoft Releases SQL Server 2008, 
Unveils New Editions 


or those who have waited patiently for SQL Server 
2008’s release to manufacturing (RTM), the wait is 

over. SQL Server 2008 RTM d in early August, almost 
six months after the official launch of the product in 
February 2008. In contrast, Visual Studio 2008 and 
Windows Server 2008, which were launched around the 
same time as SQL Server 2008, RTM'd months ago. 

Although SQL Server 2008 isn't the giant leap 
forward that SQL Server 2005 was, the product offers 
several new and improved data management, busi- 
ness intelligence, and development features. These 
features include support for policy-based management, 
auditing, large-scale data warehousing, geospatial data, 
and advanced reporting and analysis functionality. 

Ted Kummert, corporate vice president of the Data 
and Storage Platform Division at Microsoft, notes 
that “SQL Server 2008 is the only major database that 
includes comprehensive, tightly integrated function- 
ality for data management, as well as advanced busi- 
ness intelligence out of the box. By offering a complete 
solution, we save customers time and money, and allow 
them to focus on deriving the most value from their 
data assets." 

Microsoft now offers 
the following several 
editions of SOL Server 
2008: 

* SQL Server 2008 Enter- 


For more information about SQL Server 2008: 

"Migrating to SQL Server 2008," 
InstantDoc ID 99499 

"What's New іп SQL Server 2008,” 
InstantDoc ID 98574 

"SQL Server as a Data Platform. . . Finally," 
InstantDoc ID 97676 

"How Do | Upgrade to SQL Server 2008,” 
InstantDoc ID 98573 

"New Datatypes in SQL Server 2008," 
InstantDoc ID 97686 

"Can't Wait for SQL Server 2008," 
InstantDoc ID 96801 

"Microsoft Pushes SQL Server 2008 RTM Back 
to Third Quarter 2008," 
InstantDoc ID 98161 
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prise is designed for 
widespread enterprise 
use and provides sup- 
port for scalability, data 
warehousing, security, 
advanced analytics, and 
reporting. This edition 
is for consolidating 
servers and performing 
large-scale OLTP. 

* SQL Server 2008 
Standard is the stan- 
dard platform for 
running departmental 
applications. 


* SQL Server 2008 Workgroup delivers remote syn- 
chronization and management for running branch 
applications. 


“SQL Server 2008 is the 
only major database that 
includes comprehensive, 
tightly integrated func- 
tionality for data manage- 
ment, as well as advanced 
business intelligence out of the box. 
By offering a complete solution, we 
save customers time and money, and 
allow them to focus on deriving the 
most value from their data assets." 


—Microsoft Corporate Vice President of Data 
and Storage Platform, Ted Kummert 


* SQL Server 2008 Web is for Internet-facing, web- 
serving environments running on Windows Server. 
This edition provides tools to support web applica- 
tions or hosting solutions for customers. 

* SQL Server 2008 Developer lets developers build 
and test applications with SQL Server. This edition 
has the functionality of SQL Server Enterprise but 
is licensed only for development. You can easily 
upgrade applications and databases developed on 
this edition to SQL Server 2008 Enterprise. 

* SQL Server 2008 Express is a free edition of SQL 
Server that features core database functionality, 
including all the new SQL Server 2008 data types, in 
a small footprint. 

* SQL Server Compact 3.5 is a free, embedded data- 
base designed for developers and can be used for 
building applications for mobile devices, desktops, 
and web clients. SQL Server Compact runs on all 
Microsoft Windows platforms, including Windows 
Vista and Windows XP, and devices that run 
Windows such as Pocket PCs and smartphones. 


Microsoft has announced that pricing for SQL Server 
will not increase with SQL Server 2008. ЕИ 
InstantDoc ID 99953 
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he absolute worst time to find out that your 

recovery plans don't work is right in the middle 
of a critical system restore. Follow these SQL Server 
backup best practices to ensure that you really can 
restore your system when (not if) it goes down. 


bases might need to back up the transaction log only every 
half hour or every hour. 


Michael Otey 


(motey@ sqlmag.com) is technical director 


Regularly Back Up System 
Databases 

Your backup strategy is incomplete without a plan to back 
up SQL Server system databases (master, model, msdb). 


for Windows IT Pro and SQL Server Magazine 
and author of Microsoft SQL Server 2008 New 
Features (Osborne/McGraw-Hill). 


Perform Full Backups Daily 


or her birthday, | gave my sister a card embossed 
with golden print that reads “The economy 
stinks. Be happy you got this card.” However disap- Jo 


pointing the birthday gift eT ee joke) 
most likely was, the shiny ge on it is ac 


A full database backup is the foundation for every 
DBAs data protection plan and in most cases 
should be performed daily. SQL Server supports 
online backups, allowing end users and SQL Server 
jobs to be active while the backup operation occurs. 
Even so, large databases can take a long time to 
back up. Strategies for reducing the backup window 
include backing up to disk and utilizing backup 
data compression. 


Perform Frequent 

Transaction Log Backups 

Next most important is to back up the transaction 
log, which contains all of the recent activity in the 
database and can be used to restore a database to 
a given point in time. Backing up the transaction 
log also truncates it, keeping it from becoming full. 
Like database backups, transaction log backups can 
occur while the system is active. Organizations with 
active databases might back up the transaction log 
every 10 minutes while those with less active data- 


ich has forced compa 
sometimes shove—employees of 


recently 


b Hound is an online job-search engine that 
es on the IT industry. Job seekers can find 
Ositions from top IT companies 
on the site or via email job alerts—no registration 


These databases contain system configuration information 
as well as SQL Server job information that needs to be 
restored as part of a total system restore. Back up system 
databases daily for frequently changing instances, weekly 
for more stable installations. 


Back Up the Host OS Daily 

SQL Server runs on top of the OS and an event such 
as a hardware failure could require a complete system 
restore, beginning with the OS. Therefore, daily backups 
of the host OS are a good idea. At a minimum, back up 
the host system partition following any system updates or 
configuration changes. 


Practice Recovery Operations 
Changing business requirements can affect your plans, 
quickly making backup strategies obsolete. Test your 
strategies regularly in different scenarios, including both 
system and individual database restores, to ensure your 
backup plans really work when you need them. 500 
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* Performance Dashboard with relevant SQL Server 
and Windows metrics 


* Real-time and historical performance analysis 

* Disk activity, latency, and capacity monitoring 

* Top SQL analysis highlights heaviest queries 

* Graphical blocking and deadlock analysis 

* Calendar views of Top SQL, blocks and deadlocks 

* One-click and automated tracing with Quick Trace™ 


Free Trial Download: sqlsentry.net/sgl-performance SENTRY 


OVER 10,000 


* Our auditors visit quarterly and have been very pleased with the level of tracking and 


reporting that we have — thanks to SOL compliance manager.” 


COMPLIANCE 


“SQL compliance manager is a perfect solution for auditing high-transaction servers. 


It allows us to monitor any changes and attempted changes by users, date and system." 


AUDITS PASSED. 


* Unlike other products, SOL compliance manager was ready-to-use right out of the box! 


But it is also very easy to customize in the future if we wish." 
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Download SOL compliance manager free 14-day trial today! 
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